Sep 04 18:57:52 devstack cinder-volume[76606]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 18:57:52 devstack cinder-volume[76606]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 18:57:52 devstack cinder-volume[76606]: we strongly recommend against using it for new projects. Sep 04 18:57:52 devstack cinder-volume[76606]: If you are already using Eventlet, we recommend migrating to a different Sep 04 18:57:52 devstack cinder-volume[76606]: framework. For more detail see Sep 04 18:57:52 devstack cinder-volume[76606]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 18:57:52 devstack cinder-volume[76606]: import eventlet # noqa Sep 04 18:57:54 devstack cinder-volume[76606]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76606) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 18:57:54 devstack cinder-volume[76606]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76606) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 18:57:54 devstack cinder-volume[76606]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76606) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 18:57:55 devstack cinder-volume[76606]: INFO dbcounter [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Registered counter for database cinder Sep 04 18:57:55 devstack cinder-volume[76606]: DEBUG oslo_db.sqlalchemy.engines [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76606) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 18:57:55 devstack cinder-volume[76606]: DEBUG dbcounter [-] [76606] Writer thread running {{(pid=76606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 18:57:55 devstack cinder-volume[76606]: INFO cinder.rpc [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 18:57:55 devstack cinder-volume[76606]: INFO cinder.rpc [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 18:57:55 devstack cinder-volume[76606]: DEBUG oslo_db.sqlalchemy.engines [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76606) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 18:57:55 devstack cinder-volume[76606]: INFO cinder.volume.manager [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Determined volume DB was empty at startup. Sep 04 18:57:55 devstack cinder-volume[76606]: DEBUG cinder.volume.manager [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76606) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 18:57:55 devstack cinder-volume[76606]: INFO cinder.volume.manager [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 04 18:57:55 devstack cinder-volume[76606]: WARNING stevedore.named [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 18:57:55 devstack cinder-volume[76606]: WARNING castellan.key_manager [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 18:57:55 devstack cinder-volume[76606]: WARNING cinder.keymgr.conf_key_mgr [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG cinder.volume.drivers.lvm [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76606) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_concurrency.processutils [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_concurrency.processutils [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] CMD "cinder-rtstool verify" returned: 0 in 0.415s {{(pid=76606) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_db.sqlalchemy.engines [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76606) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 18:57:56 devstack cinder-volume[76606]: INFO cinder.rpc [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 04 18:57:56 devstack cinder-volume[76606]: INFO cinder.rpc [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 04 18:57:56 devstack cinder-volume[76606]: WARNING stevedore.named [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 18:57:56 devstack cinder-volume[76606]: WARNING castellan.key_manager [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 18:57:56 devstack cinder-volume[76606]: INFO cinder.volume.manager [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_db.sqlalchemy.engines [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76606) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 18:57:56 devstack cinder-volume[76606]: INFO oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Starting 1 workers Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Started child 76750 {{(pid=76606) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Full set of CONF: {{(pid=76606) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] ******************************************************************************** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Configuration options gathered from: {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] ================================================================================ {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] allow_availability_zone_fallback = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] allow_compression_on_image_upload = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] allowed_direct_url_schemes = [] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] api_rate_limit = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] auth_strategy = keystone {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] az_cache_duration = 3600 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_availability_zone = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_host = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_name = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_stats_polling_interval = 60 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backup_api_class = cinder.backup.api.API {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backup_name_template = backup-%s {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backup_use_same_host = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backup_use_temp_snapshot = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] chap_password = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] chap_username = {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cinder_internal_tenant_project_id = 6313c5ac8a4645bd8b2a77a49ab97b06 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cinder_internal_tenant_user_id = 0f0f152d5c394a49908bfff82e7799e7 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cloned_volume_same_az = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cluster = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] compression_format = gzip {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76750]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] compute_api_class = cinder.compute.nova.API {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] config_dir = [] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] config_source = [] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] control_exchange = openstack {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] debug = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] default_availability_zone = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] default_group_type = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] default_volume_type = lvmdriver-1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] disk_geometry = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] driver_client_cert = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] driver_client_cert_key = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] driver_data_namespace = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] driver_ssl_cert_path = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] driver_ssl_cert_verify = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] driver_use_ssl = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] enable_force_upload = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] enable_new_services = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] enable_unsupported_driver = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] enforce_multipath_for_image_xfer = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] filter_function = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance_api_insecure = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance_api_servers = ['http://192.168.122.33/image'] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance_api_ssl_compression = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance_ca_certificates_file = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance_catalog_info = image:glance:publicURL {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance_certfile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance_keyfile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance_num_retries = 3 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance_request_timeout = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] goodness_function = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] graceful_shutdown_timeout = 5 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] group_api_class = cinder.group.api.API {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] host = devstack {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] image_compress_on_upload = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] image_conversion_address_space_limit = 1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] image_conversion_cpu_limit = 60 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] image_conversion_disable = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] image_upload_use_cinder_backend = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] image_upload_use_internal_tenant = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] image_volume_cache_enabled = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] image_volume_cache_max_count = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] image_volume_cache_max_size_gb = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] init_host_max_objects_retrieval = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] instance_format = [instance: %(uuid)s] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] iscsi_target_flags = {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] iscsi_write_cache = on {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] iser_helper = tgtadm {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] iser_ip_address = 192.168.122.33 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] iser_port = 3260 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] log_color = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] log_config_append = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] log_dir = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] log_file = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] log_options = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] log_rotate_interval = 1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] log_rotate_interval_type = days {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] log_rotation_type = none {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] max_age = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] max_logfile_count = 30 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] max_logfile_size_mb = 200 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] max_over_subscription_ratio = 20.0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] message_reap_interval = 86400 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] message_ttl = 2592000 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] migration_create_volume_timeout_secs = 300 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] monkey_patch = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] monkey_patch_modules = [] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] my_ip = 192.168.122.33 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] no_snapshot_gb_quota = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] num_iser_scan_tries = 3 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] num_shell_tries = 3 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] num_volume_device_scan_tries = 3 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] nvmeof_conn_info_version = 1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] nvmet_ns_id = 10 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] nvmet_port_id = 1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] osapi_max_limit = 1000 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] osapi_volume_ext_list = [] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] osapi_volume_listen_port = 8776 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] osapi_volume_use_ssl = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] osapi_volume_workers = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] per_volume_size_limit = -1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] periodic_fuzzy_delay = 60 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] periodic_interval = 60 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] public_endpoint = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] publish_errors = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] quota_backup_gigabytes = 1000 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] quota_backups = 10 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] quota_gigabytes = 1000 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] quota_groups = 10 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] quota_snapshots = 10 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] quota_volumes = 10 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] rate_limit_burst = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] rate_limit_except_level = CRITICAL {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] rate_limit_interval = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] reinit_driver_count = 3 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] replication_device = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] report_discard_supported = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] report_interval = 120 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] reservation_clean_interval = 86400 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] reservation_expire = 86400 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] reserved_image_namespaces = [] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] reserved_percentage = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] rpc_response_timeout = 120 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] run_external_periodic_tasks = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] scst_target_driver = iscsi {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] scst_target_iqn_name = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] service_down_time = 720 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] shell_completion = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] snapshot_name_template = snapshot-%s {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] snapshot_same_host = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] split_loggers = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] state_path = /opt/stack/data/cinder {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] storage_availability_zone = nova {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] storage_protocol = iSCSI {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] syslog_log_facility = LOG_USER {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] target_helper = lioadm {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] target_ip_address = 192.168.122.33 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] target_port = 3260 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] target_protocol = iscsi {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] target_secondary_ip_addresses = [] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] trace_flags = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] transport_url = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] until_refresh = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] use_chap_auth = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] use_default_quota_class = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] use_journal = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] use_json = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] use_multipath_for_image_xfer = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] use_stderr = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] use_syslog = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] verify_glance_signatures = enabled {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] volume_api_class = cinder.volume.api.API {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] volume_backend_name = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] volume_clear = zero {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] volume_clear_ionice = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] volume_clear_size = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] volume_copy_bps_limit = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] volume_dd_blocksize = 1M {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] volume_name_template = volume-%s {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] volume_service_inithost_offload = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] volume_usage_audit_period = month {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] zoning_mode = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_concurrency.disable_process_locking = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76750]: INFO cinder.volume.manager [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.auth_section = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.auth_type = password {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.auth_version = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.cache = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.certfile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.include_service_catalog = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.insecure = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.interface = public {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.keyfile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcache_password = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcache_username = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.region_name = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.service_type = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.33/identity {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.backend = dogpile.cache.null {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.backend_argument = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.backend_expiration_time = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.config_prefix = cache.oslo {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.debug_cache_backend = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.enable_retry_client = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.enable_socket_keepalive = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.enabled = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.expiration_time = 600 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.hashclient_retry_attempts = 2 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.memcache_dead_retry = 300 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.memcache_pool_maxsize = 10 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.memcache_sasl_enabled = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.password = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.proxies = [] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.redis_db = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.redis_server = localhost:6379 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.retry_attempts = 2 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.retry_delay = 0.0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.socket_keepalive_count = 1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.socket_keepalive_idle = 1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.socket_keepalive_interval = 1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.socket_timeout = 1.0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.tls_allowed_ciphers = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.tls_cafile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.tls_certfile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.tls_enabled = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.tls_keyfile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cache.username = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] coordination.backend_url = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.asyncio_connection = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.asyncio_slave_connection = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.backend = sqlalchemy {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.connection = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.connection_debug = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.connection_parameters = {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.connection_recycle_time = 3600 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.connection_trace = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.db_inc_retry_interval = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.db_max_retries = 20 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.db_max_retry_interval = 10 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.db_retry_interval = 1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.max_overflow = 50 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.max_pool_size = 5 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.max_retries = 10 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.mysql_wsrep_sync_wait = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.pool_timeout = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.retry_interval = 10 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.slave_connection = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.sqlite_synchronous = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.synchronous_reader = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] database.use_db_reconnect = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_tracing.insecure = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] profiler.connection_string = messaging:// {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] profiler.enabled = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] profiler.es_doc_type = notification {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] profiler.es_scroll_size = 10000 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] profiler.es_scroll_time = 2m {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] profiler.filter_error_trace = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] profiler.hmac_keys = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] profiler.sentinel_service_name = mymaster {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] profiler.socket_timeout = 0.1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] profiler.trace_requests = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] profiler.trace_sqlalchemy = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] profiler_jaeger.process_tags = {} {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] profiler_jaeger.service_name_prefix = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] profiler_otlp.service_name_prefix = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_policy.enforce_new_defaults = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_policy.policy_default_rule = default {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_policy.policy_file = policy.yaml {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] privsep_osbrick.group = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] privsep_osbrick.helper_command = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] privsep_osbrick.user = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cinder_sys_admin.group = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cinder_sys_admin.helper_command = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] cinder_sys_admin.user = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] service_user.auth_section = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] service_user.auth_type = password {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] service_user.cafile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] service_user.certfile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] service_user.collect_timing = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] service_user.insecure = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] service_user.keyfile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] service_user.send_service_user_token = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] service_user.split_loggers = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] service_user.timeout = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] service_user.tls_ciphers = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] service_user.tls_min_version = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance.auth_section = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance.auth_type = password {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance.certfile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance.collect_timing = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance.insecure = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance.keyfile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance.region_name = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance.split_loggers = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance.timeout = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance.tls_ciphers = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] glance.tls_min_version = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.backend_availability_zone = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.chap_password = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.chap_username = {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.disk_geometry = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.driver_client_cert = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.driver_client_cert_key = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.driver_data_namespace = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.driver_use_ssl = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.extra_capabilities = {} {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.filter_function = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.goodness_function = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.iscsi_target_flags = {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.iscsi_write_cache = on {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.iser_helper = tgtadm {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.iser_ip_address = 192.168.122.33 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.iser_port = 3260 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.lvm_share_target = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.lvm_type = auto {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.num_shell_tries = 3 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.replication_device = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.report_discard_supported = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.reserved_percentage = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.target_helper = tgtadm {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.target_ip_address = 192.168.122.33 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.target_port = 3260 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.target_protocol = iscsi {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.trace_flags = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.unique_fqdn_network = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.use_chap_auth = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.volume_backend_name = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.volume_clear = zero {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.volume_clear_ionice = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.volume_clear_size = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_reports.file_event_handler = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_reports.log_dir = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.backend_host = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.chap_password = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.chap_username = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.disk_geometry = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.driver_client_cert = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.extra_capabilities = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.filter_function = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.goodness_function = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.iser_helper = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.iser_ip_address = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.043s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:57:56 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.iser_port = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.lvm_share_target = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.lvm_type = auto {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.num_shell_tries = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.replication_device = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.report_discard_supported = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.reserved_percentage = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.scst_target_driver = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.storage_protocol = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.target_helper = lioadm {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.target_ip_address = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.target_port = 3260 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.trace_flags = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.use_chap_auth = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.volume_clear = zero {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.volume_clear_size = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] lvmdriver-1.volumes_dir = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack sudo[76754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 04 18:57:56 devstack sudo[76754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.ssl = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_notifications.driver = [] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_notifications.retry = -1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] key_manager.fixed_key = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.barbican_api_version = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.barbican_endpoint = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.barbican_endpoint_type = public {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.barbican_region_name = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.cafile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.certfile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.collect_timing = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.insecure = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.keyfile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.number_of_retries = 60 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.retry_delay = 1 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.send_service_user_token = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.split_loggers = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.timeout = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.tls_ciphers = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.tls_min_version = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.verify_ssl = True {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican.verify_ssl_path = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican_service_user.auth_section = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican_service_user.auth_type = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican_service_user.cafile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican_service_user.certfile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican_service_user.collect_timing = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican_service_user.insecure = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican_service_user.keyfile = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican_service_user.split_loggers = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican_service_user.timeout = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican_service_user.tls_ciphers = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] barbican_service_user.tls_min_version = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] vault.approle_role_id = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] vault.approle_secret_id = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] vault.auth_method = approle {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] vault.auth_path = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] vault.kv_mountpoint = secret {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] vault.kv_path = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] vault.kv_version = 2 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] vault.namespace = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] vault.root_token_id = **** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] vault.ssl_ca_crt_file = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] vault.timeout = 60.0 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] vault.token_file = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] vault.token_role = None {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] vault.use_ssl = False {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 18:57:56 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] ******************************************************************************** {{(pid=76606) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 18:57:57 devstack sudo[76754]: pam_unix(sudo:session): session closed for user root Sep 04 18:57:57 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.346s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:57:57 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:57 devstack sudo[76759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 18:57:57 devstack sudo[76759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:57:57 devstack sudo[76759]: pam_unix(sudo:session): session closed for user root Sep 04 18:57:57 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.364s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:57:57 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 18:57:57 devstack cinder-volume[76750]: INFO cinder.brick.local_dev.lvm [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 04 18:57:57 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:57 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:57:57 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:57 devstack sudo[76794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 18:57:57 devstack sudo[76794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:57:57 devstack sudo[76794]: pam_unix(sudo:session): session closed for user root Sep 04 18:57:57 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:57:57 devstack cinder-volume[76750]: DEBUG cinder.brick.local_dev.lvm [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76750) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 04 18:57:57 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:57 devstack sudo[76933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 18:57:57 devstack sudo[76933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:57:58 devstack sudo[76933]: pam_unix(sudo:session): session closed for user root Sep 04 18:57:58 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.512s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:57:58 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:58 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:57:58 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:58 devstack sudo[77114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 18:57:58 devstack sudo[77114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:57:58 devstack sudo[77114]: pam_unix(sudo:session): session closed for user root Sep 04 18:57:58 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.278s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:57:58 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:58 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:57:58 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:58 devstack sudo[77224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 04 18:57:58 devstack sudo[77224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:57:59 devstack sudo[77224]: pam_unix(sudo:session): session closed for user root Sep 04 18:57:59 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.303s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:57:59 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:59 devstack sudo[77356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 18:57:59 devstack sudo[77356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:57:59 devstack sudo[77356]: pam_unix(sudo:session): session closed for user root Sep 04 18:57:59 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:57:59 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:59 devstack sudo[77373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 18:57:59 devstack sudo[77373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:57:59 devstack sudo[77373]: pam_unix(sudo:session): session closed for user root Sep 04 18:57:59 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:57:59 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:59 devstack sudo[77441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 18:57:59 devstack sudo[77441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:57:59 devstack sudo[77441]: pam_unix(sudo:session): session closed for user root Sep 04 18:57:59 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:57:59 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:57:59 devstack sudo[77460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 18:57:59 devstack sudo[77460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:58:00 devstack sudo[77460]: pam_unix(sudo:session): session closed for user root Sep 04 18:58:00 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.306s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:00 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:58:00 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:00 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:58:00 devstack sudo[77485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 18:58:00 devstack sudo[77485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:58:00 devstack sudo[77485]: pam_unix(sudo:session): session closed for user root Sep 04 18:58:00 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.323s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:00 devstack cinder-volume[76750]: INFO cinder.volume.drivers.lvm [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 04 18:58:00 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:58:00 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:00 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:58:00 devstack sudo[77554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 18:58:00 devstack sudo[77554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:58:00 devstack sudo[77554]: pam_unix(sudo:session): session closed for user root Sep 04 18:58:00 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:00 devstack cinder-volume[76750]: DEBUG cinder.volume.drivers.lvm [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Updating volume stats {{(pid=76750) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 18:58:00 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:58:00 devstack sudo[77558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 18:58:00 devstack sudo[77558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:58:01 devstack sudo[77558]: pam_unix(sudo:session): session closed for user root Sep 04 18:58:01 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:01 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:58:01 devstack sudo[77567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 18:58:01 devstack sudo[77567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:58:01 devstack sudo[77567]: pam_unix(sudo:session): session closed for user root Sep 04 18:58:01 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:01 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:58:01 devstack sudo[77570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 18:58:01 devstack sudo[77570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:58:01 devstack sudo[77570]: pam_unix(sudo:session): session closed for user root Sep 04 18:58:01 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:01 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:58:01 devstack sudo[77573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 18:58:01 devstack sudo[77573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:58:01 devstack sudo[77573]: pam_unix(sudo:session): session closed for user root Sep 04 18:58:01 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:01 devstack cinder-volume[76750]: INFO cinder.volume.driver [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Driver hasn't implemented _init_vendor_properties() Sep 04 18:58:01 devstack cinder-volume[76750]: DEBUG cinder.volume.driver [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76750) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 18:58:01 devstack cinder-volume[76750]: DEBUG oslo_db.sqlalchemy.engines [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76750) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 18:58:01 devstack cinder-volume[76750]: DEBUG dbcounter [-] [76750] Writer thread running {{(pid=76750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 18:58:01 devstack cinder-volume[76750]: DEBUG cinder.db.api [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Building query based on filter {{(pid=76750) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 18:58:01 devstack cinder-volume[76750]: DEBUG cinder.image.image_utils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76750) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 18:58:01 devstack cinder-volume[76750]: INFO cinder.keymgr.migration [None req-d8e0e448-59a6-471a-ab5a-9592bf1b0805 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 18:58:02 devstack cinder-volume[76750]: DEBUG cinder.volume.drivers.lvm [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Updating volume stats {{(pid=76750) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 18:58:02 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:58:02 devstack sudo[77577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 18:58:02 devstack sudo[77577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:58:02 devstack sudo[77577]: pam_unix(sudo:session): session closed for user root Sep 04 18:58:02 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:02 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:58:02 devstack sudo[77580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 18:58:02 devstack sudo[77580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:58:02 devstack sudo[77580]: pam_unix(sudo:session): session closed for user root Sep 04 18:58:02 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:02 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:58:02 devstack sudo[77585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 18:58:02 devstack sudo[77585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:58:02 devstack sudo[77585]: pam_unix(sudo:session): session closed for user root Sep 04 18:58:02 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.346s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:02 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:58:02 devstack sudo[77589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 18:58:02 devstack sudo[77589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:58:03 devstack sudo[77589]: pam_unix(sudo:session): session closed for user root Sep 04 18:58:03 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:03 devstack cinder-volume[76750]: DEBUG cinder.manager [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Notifying Schedulers of capabilities ... {{(pid=76750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:58:03 devstack cinder-volume[76750]: INFO cinder.volume.manager [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Driver initialization completed successfully. Sep 04 18:58:03 devstack cinder-volume[76750]: INFO cinder.manager [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Initiating service 2 cleanup Sep 04 18:58:03 devstack cinder-volume[76750]: INFO cinder.manager [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Service 2 cleanup completed. Sep 04 18:58:03 devstack cinder-volume[76750]: DEBUG cinder.service [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Creating RPC server for service cinder-volume {{(pid=76750) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 18:58:03 devstack cinder-volume[76750]: DEBUG cinder.service [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76750) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 18:58:03 devstack cinder-volume[76750]: INFO cinder.volume.manager [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 04 18:58:03 devstack cinder-volume[76750]: DEBUG cinder.volume.drivers.lvm [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Updating volume stats {{(pid=76750) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 18:58:03 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:58:03 devstack sudo[77592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 18:58:03 devstack sudo[77592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:58:03 devstack sudo[77592]: pam_unix(sudo:session): session closed for user root Sep 04 18:58:03 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:03 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:58:03 devstack sudo[77595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 18:58:03 devstack sudo[77595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:58:03 devstack sudo[77595]: pam_unix(sudo:session): session closed for user root Sep 04 18:58:03 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:03 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:58:03 devstack sudo[77600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 18:58:03 devstack sudo[77600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:58:04 devstack sudo[77600]: pam_unix(sudo:session): session closed for user root Sep 04 18:58:04 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.245s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:04 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:58:04 devstack sudo[77603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 18:58:04 devstack sudo[77603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:58:04 devstack sudo[77603]: pam_unix(sudo:session): session closed for user root Sep 04 18:58:04 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:58:04 devstack cinder-volume[76750]: INFO cinder.volume.manager [None req-6bc409c0-86e4-4826-b96f-bcb6612d5270 None None] Driver post RPC initialization completed successfully. Sep 04 18:58:06 devstack cinder-volume[76606]: DEBUG dbcounter [-] [76606] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76606) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:58:13 devstack cinder-volume[76750]: DEBUG dbcounter [-] [76750] Writing DB stats cinder:SELECT=4 {{(pid=76750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:58:14 devstack cinder-volume[76750]: DEBUG dbcounter [-] [76750] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 18:58:41 devstack cinder-volume[76750]: DEBUG oslo_service.periodic_task [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running periodic task VolumeManager._thread_info {{(pid=76750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:58:41 devstack cinder-volume[76750]: DEBUG cinder.volume.manager [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] thread count: 6 {{(pid=76750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 18:58:41 devstack cinder-volume[76750]: DEBUG cinder.volume.manager [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] thread info: [<_MainThread(MainThread, started 127573474312320)>, , , , , ] {{(pid=76750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 18:59:41 devstack cinder-volume[76750]: DEBUG oslo_service.periodic_task [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:59:41 devstack cinder-volume[76750]: DEBUG cinder.volume.drivers.lvm [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Updating volume stats {{(pid=76750) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 18:59:41 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:59:41 devstack sudo[82827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 18:59:41 devstack sudo[82827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:59:41 devstack sudo[82827]: pam_unix(sudo:session): session closed for user root Sep 04 18:59:41 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:59:41 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:59:41 devstack sudo[82830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 18:59:41 devstack sudo[82830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:59:41 devstack sudo[82830]: pam_unix(sudo:session): session closed for user root Sep 04 18:59:41 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:59:41 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:59:41 devstack sudo[82833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 18:59:41 devstack sudo[82833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:59:42 devstack sudo[82833]: pam_unix(sudo:session): session closed for user root Sep 04 18:59:42 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:59:42 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 18:59:42 devstack sudo[82836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 18:59:42 devstack sudo[82836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 18:59:42 devstack sudo[82836]: pam_unix(sudo:session): session closed for user root Sep 04 18:59:42 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 18:59:42 devstack cinder-volume[76750]: DEBUG cinder.manager [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Notifying Schedulers of capabilities ... {{(pid=76750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 18:59:42 devstack cinder-volume[76750]: DEBUG oslo_service.periodic_task [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running periodic task VolumeManager._thread_info {{(pid=76750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 18:59:42 devstack cinder-volume[76750]: DEBUG cinder.volume.manager [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] thread count: 6 {{(pid=76750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 18:59:42 devstack cinder-volume[76750]: DEBUG cinder.volume.manager [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] thread info: [<_MainThread(MainThread, started 127573474312320)>, , , , , ] {{(pid=76750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:00:14 devstack cinder-volume[76750]: DEBUG dbcounter [-] [76750] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:00:41 devstack cinder-volume[76750]: DEBUG oslo_service.periodic_task [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:00:41 devstack cinder-volume[76750]: DEBUG cinder.volume.drivers.lvm [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Updating volume stats {{(pid=76750) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 19:00:41 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:00:41 devstack sudo[84323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 19:00:41 devstack sudo[84323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:00:41 devstack sudo[84323]: pam_unix(sudo:session): session closed for user root Sep 04 19:00:41 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:00:41 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:00:41 devstack sudo[84327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 19:00:41 devstack sudo[84327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:00:41 devstack sudo[84327]: pam_unix(sudo:session): session closed for user root Sep 04 19:00:41 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:00:41 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:00:42 devstack sudo[84330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 19:00:42 devstack sudo[84330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:00:42 devstack sudo[84330]: pam_unix(sudo:session): session closed for user root Sep 04 19:00:42 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:00:42 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:00:42 devstack sudo[84349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 19:00:42 devstack sudo[84349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:00:42 devstack sudo[84349]: pam_unix(sudo:session): session closed for user root Sep 04 19:00:42 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:00:42 devstack cinder-volume[76750]: DEBUG cinder.manager [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Notifying Schedulers of capabilities ... {{(pid=76750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:01:41 devstack cinder-volume[76750]: DEBUG oslo_service.periodic_task [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:01:41 devstack cinder-volume[76750]: DEBUG cinder.volume.drivers.lvm [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Updating volume stats {{(pid=76750) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 04 19:01:41 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:01:41 devstack sudo[85835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 04 19:01:41 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:01:41 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root Sep 04 19:01:41 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:01:41 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:01:41 devstack sudo[85849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 19:01:41 devstack sudo[85849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:01:41 devstack sudo[85849]: pam_unix(sudo:session): session closed for user root Sep 04 19:01:41 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:01:41 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:01:41 devstack sudo[85852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 04 19:01:41 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:01:42 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root Sep 04 19:01:42 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:01:42 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:01:42 devstack sudo[85855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 04 19:01:42 devstack sudo[85855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:01:42 devstack sudo[85855]: pam_unix(sudo:session): session closed for user root Sep 04 19:01:42 devstack cinder-volume[76750]: DEBUG oslo_concurrency.processutils [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76750) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:01:42 devstack cinder-volume[76750]: DEBUG cinder.manager [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Notifying Schedulers of capabilities ... {{(pid=76750) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:01:42 devstack cinder-volume[76750]: DEBUG oslo_service.periodic_task [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] Running periodic task VolumeManager._thread_info {{(pid=76750) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:01:42 devstack cinder-volume[76750]: DEBUG cinder.volume.manager [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] thread count: 6 {{(pid=76750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:01:42 devstack cinder-volume[76750]: DEBUG cinder.volume.manager [None req-4bf71e19-2a92-4f0c-bb92-8dd96ae90bbb None None] thread info: [<_MainThread(MainThread, started 127573474312320)>, , , , , ] {{(pid=76750) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:02:14 devstack cinder-volume[76750]: DEBUG dbcounter [-] [76750] Writing DB stats cinder:SELECT=1 {{(pid=76750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:02:14 devstack cinder-volume[76750]: DEBUG dbcounter [-] [76750] Writing DB stats cinder:UPDATE=1 {{(pid=76750) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:02:22 devstack cinder-volume[76606]: INFO oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Caught SIGTERM, stopping children Sep 04 19:02:22 devstack cinder-volume[76606]: DEBUG oslo_concurrency.lockutils [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Acquiring lock "singleton_lock" {{(pid=76606) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 19:02:22 devstack cinder-volume[76606]: DEBUG oslo_concurrency.lockutils [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Acquired lock "singleton_lock" {{(pid=76606) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 19:02:22 devstack cinder-volume[76606]: DEBUG oslo_concurrency.lockutils [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Releasing lock "singleton_lock" {{(pid=76606) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 19:02:22 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Stop services. {{(pid=76606) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 04 19:02:22 devstack cinder-volume[76606]: DEBUG oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Killing children. {{(pid=76606) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 04 19:02:22 devstack cinder-volume[76606]: INFO oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Waiting on 1 children to exit Sep 04 19:02:23 devstack cinder-volume[76750]: DEBUG oslo_concurrency.lockutils [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Acquiring lock "singleton_lock" {{(pid=76750) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 19:02:23 devstack cinder-volume[76750]: DEBUG oslo_concurrency.lockutils [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Acquired lock "singleton_lock" {{(pid=76750) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 19:02:23 devstack cinder-volume[76750]: DEBUG oslo_concurrency.lockutils [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Releasing lock "singleton_lock" {{(pid=76750) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 19:02:23 devstack cinder-volume[76750]: WARNING amqp [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 19:02:23 devstack cinder-volume[76750]: WARNING amqp [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 19:02:23 devstack cinder-volume[76606]: INFO oslo_service.backend._eventlet.service [None req-a4b23385-250c-4427-9b6b-16b8664b0b09 None None] Child 76750 exited with status 0 Sep 04 19:02:23 devstack cinder-volume[86763]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 19:02:23 devstack cinder-volume[86763]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 19:02:23 devstack cinder-volume[86763]: we strongly recommend against using it for new projects. Sep 04 19:02:23 devstack cinder-volume[86763]: If you are already using Eventlet, we recommend migrating to a different Sep 04 19:02:23 devstack cinder-volume[86763]: framework. For more detail see Sep 04 19:02:23 devstack cinder-volume[86763]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 19:02:23 devstack cinder-volume[86763]: import eventlet # noqa Sep 04 19:02:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 19:02:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 19:02:25 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 19:02:26 devstack cinder-volume[86763]: INFO dbcounter [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Registered counter for database cinder Sep 04 19:02:26 devstack cinder-volume[86763]: DEBUG oslo_db.sqlalchemy.engines [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 19:02:26 devstack cinder-volume[86763]: DEBUG dbcounter [-] [86763] Writer thread running {{(pid=86763) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 19:02:26 devstack cinder-volume[86763]: INFO cinder.rpc [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 19:02:26 devstack cinder-volume[86763]: INFO cinder.rpc [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 19:02:26 devstack cinder-volume[86763]: DEBUG oslo_db.sqlalchemy.engines [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 19:02:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Determined volume DB was empty at startup. Sep 04 19:02:26 devstack cinder-volume[86763]: DEBUG cinder.volume.manager [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86763) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 19:02:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 04 19:02:26 devstack cinder-volume[86763]: WARNING stevedore.named [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 19:02:26 devstack cinder-volume[86763]: WARNING castellan.key_manager [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 19:02:26 devstack cinder-volume[86763]: WARNING cinder.keymgr.conf_key_mgr [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 19:02:26 devstack cinder-volume[86763]: INFO cinder.volume.manager [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 04 19:02:26 devstack cinder-volume[86763]: DEBUG oslo_db.sqlalchemy.engines [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86763) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 19:02:27 devstack cinder-volume[86763]: INFO oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Starting 1 workers Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Started child 86979 {{(pid=86763) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Full set of CONF: {{(pid=86763) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] ******************************************************************************** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Configuration options gathered from: {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 19:02:27 devstack cinder-volume[86979]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] ================================================================================ {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] allow_availability_zone_fallback = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] allow_compression_on_image_upload = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] allowed_direct_url_schemes = [] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] api_rate_limit = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] auth_strategy = keystone {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_availability_zone = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_host = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_name = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_stats_polling_interval = 60 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backup_api_class = cinder.backup.api.API {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backup_name_template = backup-%s {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backup_use_same_host = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backup_use_temp_snapshot = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] chap_password = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] chap_username = {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cinder_internal_tenant_project_id = 6313c5ac8a4645bd8b2a77a49ab97b06 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cinder_internal_tenant_user_id = 0f0f152d5c394a49908bfff82e7799e7 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cluster = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] compression_format = gzip {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] compute_api_class = cinder.compute.nova.API {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] config_dir = [] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] config_source = [] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] control_exchange = openstack {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] debug = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] default_availability_zone = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] default_group_type = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] default_volume_type = QuobyteHD {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] disk_geometry = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] driver_client_cert = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] driver_client_cert_key = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] driver_data_namespace = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] driver_ssl_cert_path = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] driver_ssl_cert_verify = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] driver_use_ssl = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] enable_new_services = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] enable_unsupported_driver = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] enabled_backends = ['QuobyteHD'] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] enforce_multipath_for_image_xfer = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] filter_function = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance_api_insecure = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance_api_servers = ['http://192.168.122.33/image'] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance_api_ssl_compression = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance_ca_certificates_file = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance_catalog_info = image:glance:publicURL {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance_certfile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance_keyfile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance_num_retries = 3 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance_request_timeout = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] goodness_function = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] graceful_shutdown_timeout = 5 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] group_api_class = cinder.group.api.API {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] host = devstack {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] image_compress_on_upload = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] image_conversion_address_space_limit = 1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] image_conversion_cpu_limit = 60 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] image_conversion_disable = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] image_upload_use_cinder_backend = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] image_upload_use_internal_tenant = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] image_volume_cache_enabled = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] image_volume_cache_max_count = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] image_volume_cache_max_size_gb = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] init_host_max_objects_retrieval = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] instance_format = [instance: %(uuid)s] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] iscsi_target_flags = {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] iscsi_write_cache = on {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] iser_helper = tgtadm {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] iser_ip_address = 192.168.122.33 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] iser_port = 3260 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] log_color = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] log_config_append = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] log_dir = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] log_file = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] log_options = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] log_rotate_interval = 1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] log_rotate_interval_type = days {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] log_rotation_type = none {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] max_age = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] max_logfile_count = 30 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] max_logfile_size_mb = 200 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] max_over_subscription_ratio = 20.0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] message_reap_interval = 86400 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] message_ttl = 2592000 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] migration_create_volume_timeout_secs = 300 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] monkey_patch = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] monkey_patch_modules = [] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] my_ip = 192.168.122.33 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] no_snapshot_gb_quota = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] num_iser_scan_tries = 3 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] num_shell_tries = 3 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] num_volume_device_scan_tries = 3 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] nvmeof_conn_info_version = 1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] nvmet_ns_id = 10 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] nvmet_port_id = 1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] osapi_max_limit = 1000 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] osapi_volume_ext_list = [] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] osapi_volume_listen_port = 8776 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] osapi_volume_use_ssl = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] osapi_volume_workers = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] per_volume_size_limit = -1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] periodic_fuzzy_delay = 60 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] periodic_interval = 60 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] public_endpoint = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] publish_errors = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] quota_backup_gigabytes = 1000 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] quota_backups = 10 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86979]: INFO cinder.volume.manager [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Starting volume driver QuobyteDriver (1.2.1) Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86979]: DEBUG cinder.volume.drivers.remotefs [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86979) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] quota_gigabytes = 1000 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] quota_groups = 10 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] quota_snapshots = 10 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] quota_volumes = 10 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] rate_limit_burst = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] rate_limit_except_level = CRITICAL {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] rate_limit_interval = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] reinit_driver_count = 3 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] replication_device = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] report_discard_supported = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] report_interval = 120 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] reservation_clean_interval = 86400 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] reservation_expire = 86400 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] reserved_image_namespaces = [] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] reserved_percentage = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] rpc_response_timeout = 120 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] run_external_periodic_tasks = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] scst_target_driver = iscsi {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] scst_target_iqn_name = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] service_down_time = 720 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] shell_completion = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] snapshot_name_template = snapshot-%s {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] split_loggers = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] state_path = /opt/stack/data/cinder {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] storage_availability_zone = nova {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] storage_protocol = iSCSI {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] syslog_log_facility = LOG_USER {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] target_helper = lioadm {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] target_ip_address = 192.168.122.33 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] target_port = 3260 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] target_protocol = iscsi {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] target_secondary_ip_addresses = [] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] trace_flags = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] transport_url = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] until_refresh = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] use_chap_auth = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] use_default_quota_class = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] use_journal = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] use_json = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] use_multipath_for_image_xfer = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] use_stderr = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] use_syslog = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] verify_glance_signatures = enabled {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] volume_api_class = cinder.volume.api.API {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] volume_backend_name = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] volume_clear = zero {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] volume_clear_ionice = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] volume_clear_size = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] volume_copy_bps_limit = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] volume_dd_blocksize = 1M {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] volume_name_template = volume-%s {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] volume_service_inithost_offload = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] volume_usage_audit_period = month {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] zoning_mode = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_concurrency.disable_process_locking = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.auth_section = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.auth_type = password {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.auth_version = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.cache = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.certfile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.include_service_catalog = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.insecure = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.interface = public {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.keyfile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcache_password = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcache_username = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.region_name = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.service_type = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.33/identity {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.backend = dogpile.cache.null {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.backend_argument = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.backend_expiration_time = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.config_prefix = cache.oslo {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.debug_cache_backend = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.enable_retry_client = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.enable_socket_keepalive = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.enabled = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.expiration_time = 600 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.hashclient_retry_attempts = 2 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.memcache_dead_retry = 300 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.memcache_pool_maxsize = 10 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.memcache_sasl_enabled = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.password = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.proxies = [] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.redis_db = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.redis_server = localhost:6379 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.retry_attempts = 2 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.retry_delay = 0.0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.socket_keepalive_count = 1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.socket_keepalive_idle = 1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.socket_keepalive_interval = 1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.socket_timeout = 1.0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.tls_allowed_ciphers = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.tls_cafile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.tls_certfile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.tls_enabled = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.tls_keyfile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cache.username = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] coordination.backend_url = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.asyncio_connection = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.asyncio_slave_connection = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.backend = sqlalchemy {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.connection = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.connection_debug = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.connection_parameters = {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.connection_recycle_time = 3600 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.connection_trace = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.db_inc_retry_interval = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.db_max_retries = 20 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.db_max_retry_interval = 10 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.db_retry_interval = 1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.max_overflow = 50 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.max_pool_size = 5 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.max_retries = 10 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.mysql_wsrep_sync_wait = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.pool_timeout = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.retry_interval = 10 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.slave_connection = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.sqlite_synchronous = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.synchronous_reader = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] database.use_db_reconnect = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_tracing.insecure = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] profiler.connection_string = messaging:// {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] profiler.enabled = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] profiler.es_doc_type = notification {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] profiler.es_scroll_size = 10000 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] profiler.es_scroll_time = 2m {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] profiler.filter_error_trace = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] profiler.hmac_keys = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] profiler.sentinel_service_name = mymaster {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] profiler.socket_timeout = 0.1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] profiler.trace_requests = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] profiler.trace_sqlalchemy = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] profiler_jaeger.process_tags = {} {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] profiler_jaeger.service_name_prefix = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] profiler_otlp.service_name_prefix = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_policy.enforce_new_defaults = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_policy.policy_default_rule = default {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_policy.policy_file = policy.yaml {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] privsep_osbrick.group = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] privsep_osbrick.helper_command = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] privsep_osbrick.user = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cinder_sys_admin.group = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cinder_sys_admin.helper_command = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] cinder_sys_admin.user = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] service_user.auth_section = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] service_user.auth_type = password {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] service_user.cafile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] service_user.certfile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] service_user.collect_timing = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] service_user.insecure = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] service_user.keyfile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] service_user.send_service_user_token = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] service_user.split_loggers = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] service_user.timeout = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] service_user.tls_ciphers = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] service_user.tls_min_version = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance.auth_section = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance.auth_type = password {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance.certfile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance.collect_timing = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance.insecure = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance.keyfile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance.region_name = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance.split_loggers = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance.timeout = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance.tls_ciphers = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] glance.tls_min_version = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.backend_availability_zone = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.chap_password = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.chap_username = {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.disk_geometry = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.driver_client_cert = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.driver_client_cert_key = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.driver_data_namespace = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.driver_use_ssl = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.extra_capabilities = {} {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.filter_function = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.goodness_function = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.iscsi_target_flags = {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.iscsi_write_cache = on {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.iser_helper = tgtadm {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.iser_ip_address = 192.168.122.33 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.iser_port = 3260 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.nas_host = {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.nas_login = admin {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.nas_mount_options = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.nas_password = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.nas_private_key = {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.nas_share_path = {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.num_shell_tries = 3 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.quobyte_volume_url = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.replication_device = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.report_discard_supported = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.reserved_percentage = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.target_helper = tgtadm {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.target_ip_address = 192.168.122.33 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.target_port = 3260 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.target_protocol = iscsi {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.trace_flags = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.unique_fqdn_network = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.use_chap_auth = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.volume_backend_name = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.volume_clear = zero {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.volume_clear_ionice = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.volume_clear_size = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86979]: DEBUG cinder.volume.drivers.quobyte [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86979) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 04 19:02:27 devstack cinder-volume[86979]: WARNING cinder.volume.drivers.quobyte [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 04 19:02:27 devstack cinder-volume[86979]: WARNING cinder.volume.drivers.quobyte [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_reports.file_event_handler = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_reports.log_dir = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.backend_availability_zone = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.backend_host = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86979]: DEBUG oslo_concurrency.processutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Running cmd (subprocess): mount.quobyte {{(pid=86979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.chap_password = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.chap_username = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.chiscsi_conf = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.disk_geometry = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.driver_client_cert = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.driver_data_namespace = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.driver_use_ssl = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.extra_capabilities = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.filter_function = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.goodness_function = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.iser_helper = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.iser_ip_address = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.iser_port = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.iser_target_prefix = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.nas_host = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.nas_login = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.nas_mount_options = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.nas_password = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.nas_private_key = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.nas_share_path = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.nas_ssh_port = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.num_shell_tries = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.nvmet_port_id = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.replication_device = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.report_discard_supported = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.reserved_percentage = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.scst_target_driver = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.storage_protocol = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.target_helper = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.target_ip_address = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.target_port = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.target_prefix = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.target_protocol = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.trace_flags = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.use_chap_auth = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.volume_clear = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.volume_clear_size = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] QuobyteHD.volumes_dir = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.ssl = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_notifications.driver = [] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_notifications.retry = -1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] key_manager.fixed_key = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.barbican_api_version = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.barbican_endpoint = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.barbican_endpoint_type = public {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.barbican_region_name = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.cafile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.certfile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.collect_timing = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.insecure = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.keyfile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.number_of_retries = 60 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.retry_delay = 1 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.send_service_user_token = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.split_loggers = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.timeout = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.tls_ciphers = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.tls_min_version = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.verify_ssl = True {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican.verify_ssl_path = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican_service_user.auth_section = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican_service_user.auth_type = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican_service_user.cafile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican_service_user.certfile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican_service_user.collect_timing = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican_service_user.insecure = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican_service_user.keyfile = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican_service_user.split_loggers = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican_service_user.timeout = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican_service_user.tls_ciphers = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] barbican_service_user.tls_min_version = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] vault.approle_role_id = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] vault.approle_secret_id = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] vault.auth_method = approle {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] vault.auth_path = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] vault.kv_mountpoint = secret {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack quobyte-client[86980]: Reading configuration file: /etc/quobyte/client.cfg Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] vault.kv_path = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] vault.kv_version = 2 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] vault.namespace = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] vault.root_token_id = **** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] vault.ssl_ca_crt_file = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack quobyte-client[86980]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 04 19:02:27 devstack cinder-volume[86979]: DEBUG oslo_concurrency.processutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] CMD "mount.quobyte" returned: 1 in 0.120s {{(pid=86979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] vault.timeout = 60.0 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] vault.token_file = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] vault.token_role = None {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] vault.use_ssl = False {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:27 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] ******************************************************************************** {{(pid=86763) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 19:02:27 devstack cinder-volume[86979]: DEBUG cinder.volume.drivers.quobyte [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=86979) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:02:27 devstack cinder-volume[86979]: INFO cinder.volume.drivers.quobyte [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 ... Sep 04 19:02:27 devstack cinder-volume[86979]: DEBUG oslo_concurrency.processutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd -c /etc/quobyte/client-cinder.cfg {{(pid=86979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:02:27 devstack sudo[86981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd -c /etc/quobyte/client-cinder.cfg Sep 04 19:02:27 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:02:27 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root Sep 04 19:02:27 devstack cinder-volume[86979]: DEBUG oslo_concurrency.processutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.409s {{(pid=86979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:02:27 devstack cinder-volume[86979]: INFO cinder.volume.drivers.quobyte [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 succeeded Sep 04 19:02:27 devstack cinder-volume[86979]: DEBUG cinder.volume.drivers.quobyte [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=86979) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:02:27 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.426s {{(pid=86979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:02:27 devstack cinder-volume[86979]: DEBUG oslo_concurrency.processutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=86979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:02:27 devstack sudo[87054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:02:27 devstack sudo[87054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:02:28 devstack sudo[87054]: pam_unix(sudo:session): session closed for user root Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG oslo_concurrency.processutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.245s {{(pid=86979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:02:28 devstack cinder-volume[86979]: INFO cinder.volume.driver [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Driver hasn't implemented _init_vendor_properties() Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG cinder.volume.driver [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7298393249512, 'free_capacity_gb': 1773.7298393249512, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86979) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG oslo_db.sqlalchemy.engines [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86979) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG dbcounter [-] [86979] Writer thread running {{(pid=86979) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG cinder.db.api [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Building query based on filter {{(pid=86979) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG cinder.image.image_utils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86979) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 19:02:28 devstack cinder-volume[86979]: INFO cinder.keymgr.migration [None req-66aa5c74-55fe-4163-9bbe-008199b82c66 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG cinder.volume.drivers.quobyte [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=86979) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG cinder.volume.drivers.quobyte [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=86979) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG oslo_concurrency.processutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=86979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:02:28 devstack sudo[87057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:02:28 devstack sudo[87057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:02:28 devstack sudo[87057]: pam_unix(sudo:session): session closed for user root Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG oslo_concurrency.processutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.241s {{(pid=86979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG cinder.manager [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Notifying Schedulers of capabilities ... {{(pid=86979) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:02:28 devstack cinder-volume[86979]: INFO cinder.volume.manager [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Driver initialization completed successfully. Sep 04 19:02:28 devstack cinder-volume[86979]: INFO cinder.manager [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Initiating service 3 cleanup Sep 04 19:02:28 devstack cinder-volume[86979]: INFO cinder.manager [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Service 3 cleanup completed. Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG cinder.service [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Creating RPC server for service cinder-volume {{(pid=86979) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG cinder.service [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86979) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 19:02:28 devstack cinder-volume[86979]: INFO cinder.volume.manager [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG cinder.volume.drivers.quobyte [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=86979) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG cinder.volume.drivers.quobyte [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=86979) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG oslo_concurrency.processutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=86979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:02:28 devstack sudo[87060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:02:28 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:02:28 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root Sep 04 19:02:28 devstack cinder-volume[86979]: DEBUG oslo_concurrency.processutils [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.237s {{(pid=86979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:02:28 devstack cinder-volume[86979]: INFO cinder.volume.manager [None req-73a30948-0518-44c1-9d0e-26f9d78a708d None None] Driver post RPC initialization completed successfully. Sep 04 19:02:33 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [None req-ae89ab6c-a218-48f4-981b-66bbe03a0a2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:02:33 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [None req-ae89ab6c-a218-48f4-981b-66bbe03a0a2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:02:33 devstack cinder-volume[86979]: DEBUG cinder.volume.drivers.quobyte [None req-ae89ab6c-a218-48f4-981b-66bbe03a0a2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=86979) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:02:33 devstack cinder-volume[86979]: DEBUG cinder.volume.drivers.quobyte [None req-ae89ab6c-a218-48f4-981b-66bbe03a0a2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=86979) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:02:33 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [None req-ae89ab6c-a218-48f4-981b-66bbe03a0a2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86979) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:02:33 devstack cinder-volume[86979]: DEBUG oslo_concurrency.processutils [None req-ae89ab6c-a218-48f4-981b-66bbe03a0a2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=86979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:02:33 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:02:33 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:02:33 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Sep 04 19:02:33 devstack cinder-volume[86979]: DEBUG oslo_concurrency.processutils [None req-ae89ab6c-a218-48f4-981b-66bbe03a0a2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.238s {{(pid=86979) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:02:33 devstack cinder-volume[86979]: DEBUG cinder.manager [None req-ae89ab6c-a218-48f4-981b-66bbe03a0a2e None None] Notifying Schedulers of capabilities ... {{(pid=86979) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:02:33 devstack cinder-volume[86763]: INFO oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Caught SIGTERM, stopping children Sep 04 19:02:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Acquiring lock "singleton_lock" {{(pid=86763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 19:02:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Acquired lock "singleton_lock" {{(pid=86763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 19:02:33 devstack cinder-volume[86763]: DEBUG oslo_concurrency.lockutils [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Releasing lock "singleton_lock" {{(pid=86763) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 19:02:33 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Stop services. {{(pid=86763) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 04 19:02:33 devstack cinder-volume[86763]: DEBUG oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Killing children. {{(pid=86763) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 04 19:02:33 devstack cinder-volume[86763]: INFO oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Waiting on 1 children to exit Sep 04 19:02:36 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Acquiring lock "singleton_lock" {{(pid=86979) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 19:02:36 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Acquired lock "singleton_lock" {{(pid=86979) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 19:02:36 devstack cinder-volume[86979]: DEBUG oslo_concurrency.lockutils [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Releasing lock "singleton_lock" {{(pid=86979) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 19:02:36 devstack cinder-volume[86979]: WARNING amqp [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 19:02:36 devstack cinder-volume[86979]: WARNING amqp [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 04 19:02:36 devstack cinder-volume[86763]: INFO oslo_service.backend._eventlet.service [None req-07d7464f-21d7-4780-93be-69fc29300f80 None None] Child 86979 exited with status 0 Sep 04 19:02:37 devstack cinder-volume[87264]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 04 19:02:37 devstack cinder-volume[87264]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 19:02:37 devstack cinder-volume[87264]: we strongly recommend against using it for new projects. Sep 04 19:02:37 devstack cinder-volume[87264]: If you are already using Eventlet, we recommend migrating to a different Sep 04 19:02:37 devstack cinder-volume[87264]: framework. For more detail see Sep 04 19:02:37 devstack cinder-volume[87264]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 19:02:37 devstack cinder-volume[87264]: import eventlet # noqa Sep 04 19:02:40 devstack cinder-volume[87264]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 04 19:02:40 devstack cinder-volume[87264]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 04 19:02:40 devstack cinder-volume[87264]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 04 19:02:41 devstack cinder-volume[87264]: INFO dbcounter [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] Registered counter for database cinder Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_db.sqlalchemy.engines [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG dbcounter [-] [87264] Writer thread running {{(pid=87264) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 19:02:41 devstack cinder-volume[87264]: INFO cinder.rpc [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 04 19:02:41 devstack cinder-volume[87264]: INFO cinder.rpc [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_db.sqlalchemy.engines [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 19:02:41 devstack cinder-volume[87264]: INFO cinder.volume.manager [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] Determined volume DB was empty at startup. Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG cinder.volume.manager [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87264) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 04 19:02:41 devstack cinder-volume[87264]: WARNING stevedore.named [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 04 19:02:41 devstack cinder-volume[87264]: WARNING castellan.key_manager [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 19:02:41 devstack cinder-volume[87264]: WARNING cinder.keymgr.conf_key_mgr [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 04 19:02:41 devstack cinder-volume[87264]: INFO cinder.volume.manager [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_db.sqlalchemy.engines [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 19:02:41 devstack cinder-volume[87264]: INFO oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] Starting 1 workers Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] Started child 87560 {{(pid=87264) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] Full set of CONF: {{(pid=87264) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] ******************************************************************************** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] Configuration options gathered from: {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] ================================================================================ {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] allow_availability_zone_fallback = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] allow_compression_on_image_upload = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] allowed_direct_url_schemes = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] api_rate_limit = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] auth_strategy = keystone {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_availability_zone = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_host = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_stats_polling_interval = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87560]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backup_api_class = cinder.backup.api.API {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backup_name_template = backup-%s {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backup_use_same_host = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backup_use_temp_snapshot = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] chap_password = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] chap_username = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cinder_internal_tenant_project_id = 6313c5ac8a4645bd8b2a77a49ab97b06 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cinder_internal_tenant_user_id = 0f0f152d5c394a49908bfff82e7799e7 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cluster = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] compression_format = gzip {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] compute_api_class = cinder.compute.nova.API {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] config_dir = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] config_source = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] control_exchange = openstack {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] debug = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] default_availability_zone = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] default_group_type = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] default_volume_type = QuobyteHD {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] disk_geometry = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] driver_client_cert = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] driver_client_cert_key = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] driver_data_namespace = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] driver_ssl_cert_path = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] driver_ssl_cert_verify = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] driver_use_ssl = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] enable_new_services = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] enable_unsupported_driver = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] enabled_backends = ['QuobyteHD'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] enforce_multipath_for_image_xfer = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] filter_function = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance_api_insecure = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance_api_servers = ['http://192.168.122.33/image'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance_api_ssl_compression = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance_ca_certificates_file = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance_catalog_info = image:glance:publicURL {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance_certfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance_keyfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance_num_retries = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance_request_timeout = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] goodness_function = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] graceful_shutdown_timeout = 5 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] group_api_class = cinder.group.api.API {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] host = devstack {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] image_compress_on_upload = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] image_conversion_address_space_limit = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] image_conversion_cpu_limit = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] image_conversion_disable = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] image_upload_use_cinder_backend = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] image_upload_use_internal_tenant = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] image_volume_cache_enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] image_volume_cache_max_count = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] image_volume_cache_max_size_gb = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] init_host_max_objects_retrieval = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] instance_format = [instance: %(uuid)s] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] iscsi_target_flags = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] iscsi_write_cache = on {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] iser_helper = tgtadm {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] iser_ip_address = 192.168.122.33 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] iser_port = 3260 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] log_color = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] log_config_append = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] log_dir = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] log_file = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] log_options = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] log_rotate_interval = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] log_rotate_interval_type = days {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] log_rotation_type = none {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] max_age = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] max_logfile_count = 30 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] max_logfile_size_mb = 200 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] max_over_subscription_ratio = 20.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] message_reap_interval = 86400 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] message_ttl = 2592000 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] migration_create_volume_timeout_secs = 300 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] monkey_patch = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Starting volume driver QuobyteDriver (1.2.1) Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] monkey_patch_modules = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87560) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] my_ip = 192.168.122.33 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] no_snapshot_gb_quota = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] num_iser_scan_tries = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] num_shell_tries = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] num_volume_device_scan_tries = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] nvmeof_conn_info_version = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] nvmet_ns_id = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] nvmet_port_id = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] osapi_max_limit = 1000 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] osapi_volume_ext_list = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] osapi_volume_listen_port = 8776 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] osapi_volume_use_ssl = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] osapi_volume_workers = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] per_volume_size_limit = -1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] periodic_fuzzy_delay = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] periodic_interval = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] public_endpoint = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] publish_errors = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] quota_backup_gigabytes = 1000 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] quota_backups = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] quota_gigabytes = 1000 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] quota_groups = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] quota_snapshots = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] quota_volumes = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] rate_limit_burst = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] rate_limit_except_level = CRITICAL {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] rate_limit_interval = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] reinit_driver_count = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] replication_device = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] report_discard_supported = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] report_interval = 120 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] reservation_clean_interval = 86400 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] reservation_expire = 86400 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] reserved_image_namespaces = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] reserved_percentage = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] rpc_response_timeout = 120 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] run_external_periodic_tasks = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] scst_target_driver = iscsi {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] scst_target_iqn_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] service_down_time = 720 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] shell_completion = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] snapshot_name_template = snapshot-%s {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] split_loggers = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] state_path = /opt/stack/data/cinder {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] storage_availability_zone = nova {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] storage_protocol = iSCSI {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] syslog_log_facility = LOG_USER {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] target_helper = lioadm {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] target_ip_address = 192.168.122.33 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] target_port = 3260 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] target_protocol = iscsi {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] target_secondary_ip_addresses = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] trace_flags = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] transport_url = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] until_refresh = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] use_chap_auth = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] use_default_quota_class = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] use_journal = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] use_json = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] use_multipath_for_image_xfer = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] use_stderr = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] use_syslog = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] verify_glance_signatures = enabled {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] volume_api_class = cinder.volume.api.API {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] volume_backend_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] volume_clear = zero {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] volume_clear_ionice = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] volume_clear_size = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] volume_copy_bps_limit = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] volume_dd_blocksize = 1M {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] volume_name_template = volume-%s {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] volume_service_inithost_offload = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] volume_usage_audit_period = month {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] zoning_mode = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_concurrency.disable_process_locking = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.auth_section = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.auth_type = password {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.auth_version = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.cache = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.certfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.include_service_catalog = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.insecure = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.interface = public {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.keyfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcache_password = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcache_username = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.region_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.service_type = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.33/identity {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.backend = dogpile.cache.null {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.backend_argument = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87560) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 04 19:02:41 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.quobyte [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 04 19:02:41 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.quobyte [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 04 19:02:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Running cmd (subprocess): mount.quobyte {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.backend_expiration_time = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.config_prefix = cache.oslo {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.debug_cache_backend = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.enable_retry_client = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.enable_socket_keepalive = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.expiration_time = 600 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.hashclient_retry_attempts = 2 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.memcache_dead_retry = 300 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.memcache_pool_maxsize = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.memcache_sasl_enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.password = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.proxies = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.redis_db = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.redis_server = localhost:6379 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.retry_attempts = 2 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.retry_delay = 0.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.socket_keepalive_count = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.socket_keepalive_idle = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.socket_keepalive_interval = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.socket_timeout = 1.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.tls_allowed_ciphers = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.tls_cafile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.tls_certfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.tls_enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.tls_keyfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cache.username = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] coordination.backend_url = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.asyncio_connection = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.asyncio_slave_connection = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.backend = sqlalchemy {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.connection = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.connection_debug = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.connection_parameters = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.connection_recycle_time = 3600 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.connection_trace = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.db_inc_retry_interval = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.db_max_retries = 20 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.db_max_retry_interval = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.db_retry_interval = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.max_overflow = 50 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.max_pool_size = 5 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.max_retries = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.mysql_wsrep_sync_wait = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.pool_timeout = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.retry_interval = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.slave_connection = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.sqlite_synchronous = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.synchronous_reader = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] database.use_db_reconnect = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_tracing.insecure = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] profiler.connection_string = messaging:// {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] profiler.enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] profiler.es_doc_type = notification {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] profiler.es_scroll_size = 10000 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] profiler.es_scroll_time = 2m {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] profiler.filter_error_trace = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] profiler.hmac_keys = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] profiler.sentinel_service_name = mymaster {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] profiler.socket_timeout = 0.1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] profiler.trace_requests = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] profiler.trace_sqlalchemy = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] profiler_jaeger.process_tags = {} {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] profiler_jaeger.service_name_prefix = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] profiler_otlp.service_name_prefix = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_policy.enforce_new_defaults = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_policy.policy_default_rule = default {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_policy.policy_file = policy.yaml {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] privsep_osbrick.group = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] privsep_osbrick.helper_command = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] privsep_osbrick.user = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cinder_sys_admin.group = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cinder_sys_admin.helper_command = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] cinder_sys_admin.user = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] service_user.auth_section = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] service_user.auth_type = password {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] service_user.cafile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] service_user.certfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] service_user.collect_timing = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] service_user.insecure = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] service_user.keyfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] service_user.send_service_user_token = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] service_user.split_loggers = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] service_user.timeout = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] service_user.tls_ciphers = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] service_user.tls_min_version = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance.auth_section = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance.auth_type = password {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance.certfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance.collect_timing = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance.insecure = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance.keyfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance.region_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance.split_loggers = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance.timeout = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance.tls_ciphers = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] glance.tls_min_version = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.backend_availability_zone = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.chap_password = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.chap_username = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.disk_geometry = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.driver_client_cert = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.driver_client_cert_key = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:41 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.driver_data_namespace = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.driver_use_ssl = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.extra_capabilities = {} {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.filter_function = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.goodness_function = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.iscsi_target_flags = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.iscsi_write_cache = on {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.iser_helper = tgtadm {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.iser_ip_address = 192.168.122.33 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.iser_port = 3260 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.nas_host = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.nas_login = admin {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.nas_mount_options = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.nas_password = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.nas_private_key = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack quobyte-client[87561]: Reading configuration file: /etc/quobyte/client.cfg Sep 04 19:02:42 devstack quobyte-client[87561]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.nas_share_path = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] CMD "mount.quobyte" returned: 1 in 0.105s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.num_shell_tries = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.quobyte_volume_url = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.replication_device = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.report_discard_supported = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.reserved_percentage = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.target_helper = tgtadm {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.target_ip_address = 192.168.122.33 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.target_port = 3260 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.target_protocol = iscsi {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.trace_flags = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.unique_fqdn_network = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.use_chap_auth = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.volume_backend_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.volume_clear = zero {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.volume_clear_ionice = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.volume_clear_size = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_reports.file_event_handler = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_reports.log_dir = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.backend_availability_zone = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.backend_host = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.chap_password = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.chap_username = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.chiscsi_conf = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.disk_geometry = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.driver_client_cert = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.driver_data_namespace = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.driver_use_ssl = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.extra_capabilities = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.filter_function = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.goodness_function = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.iser_helper = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.iser_ip_address = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.iser_port = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.iser_target_prefix = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.nas_host = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.nas_login = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.nas_mount_options = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.nas_password = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.nas_private_key = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.nas_share_path = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.nas_ssh_port = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.num_shell_tries = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.nvmet_port_id = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack sudo[87570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.replication_device = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.report_discard_supported = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.reserved_percentage = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.scst_target_driver = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack sudo[87570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.storage_protocol = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.target_helper = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.target_ip_address = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.target_port = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.target_prefix = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.target_protocol = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.trace_flags = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.use_chap_auth = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.volume_clear = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.volume_clear_size = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] QuobyteHD.volumes_dir = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.ssl = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_notifications.driver = [] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_notifications.retry = -1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] key_manager.fixed_key = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.barbican_api_version = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.barbican_endpoint = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.barbican_endpoint_type = public {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.barbican_region_name = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.cafile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.certfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.collect_timing = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.insecure = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.keyfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.number_of_retries = 60 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.retry_delay = 1 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.send_service_user_token = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.split_loggers = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.timeout = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.tls_ciphers = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.tls_min_version = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.verify_ssl = True {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican.verify_ssl_path = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican_service_user.auth_section = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican_service_user.auth_type = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican_service_user.cafile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican_service_user.certfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican_service_user.collect_timing = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican_service_user.insecure = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican_service_user.keyfile = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican_service_user.split_loggers = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican_service_user.timeout = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican_service_user.tls_ciphers = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] barbican_service_user.tls_min_version = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] vault.approle_role_id = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] vault.approle_secret_id = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] vault.auth_method = approle {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] vault.auth_path = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] vault.kv_mountpoint = secret {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] vault.kv_path = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] vault.kv_version = 2 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] vault.namespace = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] vault.root_token_id = **** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] vault.ssl_ca_crt_file = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] vault.timeout = 60.0 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] vault.token_file = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] vault.token_role = None {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] vault.use_ssl = False {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 04 19:02:42 devstack cinder-volume[87264]: DEBUG oslo_service.backend._eventlet.service [None req-771447df-f9a1-4477-8862-38c6ed369a88 None None] ******************************************************************************** {{(pid=87264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 04 19:02:42 devstack sudo[87570]: pam_unix(sudo:session): session closed for user root Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.329s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:02:42 devstack cinder-volume[87560]: INFO cinder.volume.driver [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Driver hasn't implemented _init_vendor_properties() Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG cinder.volume.driver [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7298393249512, 'free_capacity_gb': 1773.7298393249512, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87560) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG oslo_db.sqlalchemy.engines [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87560) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writer thread running {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG cinder.db.api [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Building query based on filter {{(pid=87560) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87560) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:02:42 devstack cinder-volume[87560]: INFO cinder.keymgr.migration [None req-916e0288-8579-4e71-ba37-a759c7fd51d9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 04 19:02:42 devstack sudo[87577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:02:42 devstack sudo[87577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:02:42 devstack sudo[87577]: pam_unix(sudo:session): session closed for user root Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.247s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:02:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Driver initialization completed successfully. Sep 04 19:02:42 devstack cinder-volume[87560]: INFO cinder.manager [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Initiating service 3 cleanup Sep 04 19:02:42 devstack cinder-volume[87560]: INFO cinder.manager [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Service 3 cleanup completed. Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG cinder.service [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Creating RPC server for service cinder-volume {{(pid=87560) start /opt/stack/cinder/cinder/service.py:231}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG cinder.service [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87560) start /opt/stack/cinder/cinder/service.py:237}} Sep 04 19:02:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:02:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:02:42 devstack sudo[87595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:02:42 devstack sudo[87595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:02:43 devstack sudo[87595]: pam_unix(sudo:session): session closed for user root Sep 04 19:02:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.239s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:02:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dfb03483-cd8f-4968-9912-63f72904ad4c None None] Driver post RPC initialization completed successfully. Sep 04 19:02:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:02:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 6 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:02:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:02:51 devstack cinder-volume[87264]: DEBUG dbcounter [-] [87264] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87264) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:02:52 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:02:53 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=1 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:03:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:03:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:03:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:03:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:03:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:03:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:03:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:03:45 devstack sudo[88068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:03:45 devstack sudo[88068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:03:45 devstack sudo[88068]: pam_unix(sudo:session): session closed for user root Sep 04 19:03:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.398s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:03:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:03:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:03:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 6 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:03:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:04:01 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:04:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Flow 'volume_create_manager' (d7644544-7d85-43cf-9ad7-4213b8cb7732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:04:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8907996d-da4d-49ae-8277-6e5fa9c9e32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8907996d-da4d-49ae-8277-6e5fa9c9e32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1906371274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde19c10-d772-4f1f-aad1-a0f578da29d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59f891615c6f4e84a5ef109203b28335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:04:02Z,use_quota=True,user_id='52d8cd02110c4f9b9c74ccf02b092374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8b16ae-4d8f-4ff8-ab94-3327ba79c3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8b16ae-4d8f-4ff8-ab94-3327ba79c3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268d7b4c-e215-4678-afca-cde64bc86748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268d7b4c-e215-4678-afca-cde64bc86748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bde19c10-d772-4f1f-aad1-a0f578da29d2', 'volume_name': 'volume-bde19c10-d772-4f1f-aad1-a0f578da29d2', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa383150-739c-49f6-bb80-f1cc65bf327c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa383150-739c-49f6-bb80-f1cc65bf327c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb07904-eca6-44aa-a44a-9906c3e034ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:02 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Volume bde19c10-d772-4f1f-aad1-a0f578da29d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bde19c10-d772-4f1f-aad1-a0f578da29d2', 'volume_size': 1} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1906371274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bde19c10-d772-4f1f-aad1-a0f578da29d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='59f891615c6f4e84a5ef109203b28335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:04:02Z,use_quota=True,user_id='52d8cd02110c4f9b9c74ccf02b092374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Creating volume bde19c10-d772-4f1f-aad1-a0f578da29d2 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:04:02 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bde19c10-d772-4f1f-aad1-a0f578da29d2 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:02 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bde19c10-d772-4f1f-aad1-a0f578da29d2 1073741824 Sep 04 19:04:02 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Flow 'volume_create_manager' (cef96a90-0ef0-4c92-81c8-7e190d0a9825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b11b06-3609-4171-b7aa-25709e56a703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69b11b06-3609-4171-b7aa-25709e56a703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-728755111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e62e85-4ddb-4004-8c8f-fde24a2109c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887297cb17f04b739e225b9e9fabdc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:04:03Z,use_quota=True,user_id='131e26223ac9473bbd473299980a64ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4dbba57-c2f6-4cb2-b326-ddc80dc20681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4dbba57-c2f6-4cb2-b326-ddc80dc20681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437628b6-e0ee-4c64-83ee-9e5518484e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437628b6-e0ee-4c64-83ee-9e5518484e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8e62e85-4ddb-4004-8c8f-fde24a2109c9', 'volume_name': 'volume-a8e62e85-4ddb-4004-8c8f-fde24a2109c9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d87eb6-79c3-4284-8c7c-0f335102d904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0d87eb6-79c3-4284-8c7c-0f335102d904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc780d0-c9a6-423c-974e-c1d4731a77ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:02 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Volume a8e62e85-4ddb-4004-8c8f-fde24a2109c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8e62e85-4ddb-4004-8c8f-fde24a2109c9', 'volume_size': 1} Sep 04 19:04:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:03 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bde19c10-d772-4f1f-aad1-a0f578da29d2 1073741824" returned: 0 in 1.078s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bde19c10-d772-4f1f-aad1-a0f578da29d2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:03 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bde19c10-d772-4f1f-aad1-a0f578da29d2 Sep 04 19:04:03 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:03 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bde19c10-d772-4f1f-aad1-a0f578da29d2" returned: 0 in 0.366s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.884s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-728755111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8e62e85-4ddb-4004-8c8f-fde24a2109c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='887297cb17f04b739e225b9e9fabdc4c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:04:03Z,use_quota=True,user_id='131e26223ac9473bbd473299980a64ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Creating volume a8e62e85-4ddb-4004-8c8f-fde24a2109c9 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:04:03 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a8e62e85-4ddb-4004-8c8f-fde24a2109c9 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:03 devstack sudo[88687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a8e62e85-4ddb-4004-8c8f-fde24a2109c9 1073741824 Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb07904-eca6-44aa-a44a-9906c3e034ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bde19c10-d772-4f1f-aad1-a0f578da29d2', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:03 devstack sudo[88687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7baed0-0256-4b07-a5ae-9bc9e385c2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:03 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Volume volume-bde19c10-d772-4f1f-aad1-a0f578da29d2 (bde19c10-d772-4f1f-aad1-a0f578da29d2): created successfully Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de7baed0-0256-4b07-a5ae-9bc9e385c2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Flow 'volume_create_manager' (d7644544-7d85-43cf-9ad7-4213b8cb7732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:04:03 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a42ffefa-927d-4761-b9eb-f6c8dbc4fb44 tempest-DeleteServersTestJSON-869975656 None] Created volume successfully. Sep 04 19:04:04 devstack sudo[88687]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a8e62e85-4ddb-4004-8c8f-fde24a2109c9 1073741824" returned: 0 in 0.853s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a8e62e85-4ddb-4004-8c8f-fde24a2109c9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:04 devstack sudo[88695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a8e62e85-4ddb-4004-8c8f-fde24a2109c9 Sep 04 19:04:04 devstack sudo[88695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:05 devstack sudo[88695]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a8e62e85-4ddb-4004-8c8f-fde24a2109c9" returned: 0 in 0.406s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:04:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fc780d0-c9a6-423c-974e-c1d4731a77ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8e62e85-4ddb-4004-8c8f-fde24a2109c9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351123f6-a1ca-4291-ba63-798697a7d6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:05 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Volume volume-a8e62e85-4ddb-4004-8c8f-fde24a2109c9 (a8e62e85-4ddb-4004-8c8f-fde24a2109c9): created successfully Sep 04 19:04:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (351123f6-a1ca-4291-ba63-798697a7d6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Flow 'volume_create_manager' (cef96a90-0ef0-4c92-81c8-7e190d0a9825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:04:05 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-afb5d5fd-481b-4611-b168-b38af54b7fcc tempest-VolumesAdminNegativeTest-1115919805 None] Created volume successfully. Sep 04 19:04:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Acquiring lock "cinder-a8e62e85-4ddb-4004-8c8f-fde24a2109c9-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:04:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Lock "cinder-a8e62e85-4ddb-4004-8c8f-fde24a2109c9-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:04:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Acquiring lock "cinder-quobyte-a8e62e85-4ddb-4004-8c8f-fde24a2109c9" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:04:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Lock "cinder-quobyte-a8e62e85-4ddb-4004-8c8f-fde24a2109c9" acquired by "delete_volume" :: waited 0.047s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:04:06 devstack cinder-volume[87560]: INFO oslo.privsep.daemon [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpktgqgd1q/privsep.sock'] Sep 04 19:04:06 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpktgqgd1q/privsep.sock Sep 04 19:04:06 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:08 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 04 19:04:08 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 04 19:04:08 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 04 19:04:08 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: Sep 04 19:04:08 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 04 19:04:08 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 04 19:04:08 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 04 19:04:08 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: Sep 04 19:04:08 devstack cinder-volume[87560]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 04 19:04:09 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:09 devstack cinder-volume[87560]: INFO oslo.privsep.daemon [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Spawned new privsep daemon via rootwrap Sep 04 19:04:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Accepted privsep connection to /tmp/tmpktgqgd1q/privsep.sock {{(pid=87560) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 04 19:04:09 devstack cinder-volume[87560]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 04 19:04:09 devstack cinder-volume[87560]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 04 19:04:09 devstack cinder-volume[87560]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 04 19:04:09 devstack cinder-volume[87560]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88714 Sep 04 19:04:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d4f047-bcc3-46b1-9d92-b5c2e49e061b]: (2,) {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:04:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6924934f-80f6-4734-99ec-889243ce2a20]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:04:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a8e62e85-4ddb-4004-8c8f-fde24a2109c9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:09 devstack sudo[88719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a8e62e85-4ddb-4004-8c8f-fde24a2109c9 Sep 04 19:04:09 devstack sudo[88719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:09 devstack cinder-volume[87560]: WARNING py.warnings [req-8da45291-f59e-4e06-8271-9fc7d22a981f req-e9fb1078-bf5b-4b72-8980-591d05504fc8 tempest-DeleteServersTestJSON-869975656 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 04 19:04:09 devstack cinder-volume[87560]: .first() Sep 04 19:04:09 devstack cinder-volume[87560]: Sep 04 19:04:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-8da45291-f59e-4e06-8271-9fc7d22a981f req-e9fb1078-bf5b-4b72-8980-591d05504fc8 tempest-DeleteServersTestJSON-869975656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-8da45291-f59e-4e06-8271-9fc7d22a981f req-e9fb1078-bf5b-4b72-8980-591d05504fc8 tempest-DeleteServersTestJSON-869975656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-8da45291-f59e-4e06-8271-9fc7d22a981f req-e9fb1078-bf5b-4b72-8980-591d05504fc8 tempest-DeleteServersTestJSON-869975656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-8da45291-f59e-4e06-8271-9fc7d22a981f req-e9fb1078-bf5b-4b72-8980-591d05504fc8 tempest-DeleteServersTestJSON-869975656 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-bde19c10-d772-4f1f-aad1-a0f578da29d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c0d81e3-c325-438c-b7c0-70da51cde70d', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:04:10 devstack sudo[88719]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a8e62e85-4ddb-4004-8c8f-fde24a2109c9" returned: 0 in 0.872s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a8e62e85-4ddb-4004-8c8f-fde24a2109c9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-8da45291-f59e-4e06-8271-9fc7d22a981f req-e9fb1078-bf5b-4b72-8980-591d05504fc8 tempest-DeleteServersTestJSON-869975656 None] attachment_update completed successfully. Sep 04 19:04:10 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a8e62e85-4ddb-4004-8c8f-fde24a2109c9 Sep 04 19:04:10 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:10 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a8e62e85-4ddb-4004-8c8f-fde24a2109c9" returned: 0 in 0.645s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Lock "cinder-quobyte-a8e62e85-4ddb-4004-8c8f-fde24a2109c9" released by "delete_volume" :: held 3.922s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:04:10 devstack cinder-volume[87560]: WARNING cinder.quota [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:04:10 devstack cinder-volume[87560]: WARNING cinder.quota [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:04:10 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Created reservations ['fc77adf2-6bee-40cd-b85c-46a775b408bf', 'f5f4bcf1-a513-43ef-adfb-acf5f0b9202a', '460ec326-3351-4fb3-9ed0-7b8defbcd1b0', '95b3a119-1d8a-4b57-ba14-260542c1a5d2'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:04:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:04:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:04:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:11 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:04:11 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:11 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.426s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:11 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:04:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Deleted volume successfully. Sep 04 19:04:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-37ea55c9-0d67-478e-ba17-18a23d2e5122 tempest-VolumesAdminNegativeTest-1115919805 None] Lock "cinder-a8e62e85-4ddb-4004-8c8f-fde24a2109c9-delete_volume" released by "delete_volume" :: held 4.850s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:04:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-5ced30e8-e773-4e85-b878-de22cba2a739 req-313bb2b2-6e98-4653-8f43-83be0976fd59 tempest-DeleteServersTestJSON-869975656 None] Terminate volume connection completed successfully. Sep 04 19:04:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-5ced30e8-e773-4e85-b878-de22cba2a739 req-313bb2b2-6e98-4653-8f43-83be0976fd59 tempest-DeleteServersTestJSON-869975656 None] Deleting attachment 7c0d81e3-c325-438c-b7c0-70da51cde70d. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:04:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Acquiring lock "cinder-bde19c10-d772-4f1f-aad1-a0f578da29d2-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:04:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Lock "cinder-bde19c10-d772-4f1f-aad1-a0f578da29d2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:04:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Acquiring lock "cinder-quobyte-bde19c10-d772-4f1f-aad1-a0f578da29d2" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:04:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Lock "cinder-quobyte-bde19c10-d772-4f1f-aad1-a0f578da29d2" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:04:17 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e17aab-f814-47a6-b521-7c069a5b9d6d]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:04:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bde19c10-d772-4f1f-aad1-a0f578da29d2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:17 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bde19c10-d772-4f1f-aad1-a0f578da29d2 Sep 04 19:04:17 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:17 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bde19c10-d772-4f1f-aad1-a0f578da29d2" returned: 0 in 0.396s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bde19c10-d772-4f1f-aad1-a0f578da29d2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:17 devstack sudo[89241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bde19c10-d772-4f1f-aad1-a0f578da29d2 Sep 04 19:04:17 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:18 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bde19c10-d772-4f1f-aad1-a0f578da29d2" returned: 0 in 0.268s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Lock "cinder-quobyte-bde19c10-d772-4f1f-aad1-a0f578da29d2" released by "delete_volume" :: held 0.711s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:04:18 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Created reservations ['b701884c-b074-461c-b487-915eae2c9ae5', 'd0a7b428-9138-4785-b991-09b2f193c8e2', '8c903f2d-d45e-4b4e-a6d0-d2a6fa2cf6eb', '8f3f5758-eee6-4c86-b7e0-5ce5a73ce9cf'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:04:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:04:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:04:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:18 devstack sudo[89244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:04:18 devstack sudo[89244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:18 devstack sudo[89244]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.311s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:18 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:04:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Deleted volume successfully. Sep 04 19:04:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-335663e6-d16a-43d9-b143-7a61357d5ebe tempest-DeleteServersTestJSON-869975656 None] Lock "cinder-bde19c10-d772-4f1f-aad1-a0f578da29d2-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Flow 'volume_create_manager' (d867302d-578d-464b-a9d0-1cdf03d485e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4776a8-77a4-473b-bc62-8082e263708a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4776a8-77a4-473b-bc62-8082e263708a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1222802209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c58c2a-c6b0-49eb-8001-f8c4a8667fa5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ddb0c9a2ad349d2b26b05c8945e04ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:04:26Z,use_quota=True,user_id='947a5e64e60643ddaf1b2b4ebcc779fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e5049d-e8b6-45fc-857e-972097d3769f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69e5049d-e8b6-45fc-857e-972097d3769f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3da8af-883c-4d58-849a-90b3f0109eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c3da8af-883c-4d58-849a-90b3f0109eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74c58c2a-c6b0-49eb-8001-f8c4a8667fa5', 'volume_name': 'volume-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee6d3ee-62b9-4ce9-89d3-3a25ff96663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee6d3ee-62b9-4ce9-89d3-3a25ff96663d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f678148-02d5-45dc-b1b5-8b5ce14e176c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:26 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Volume 74c58c2a-c6b0-49eb-8001-f8c4a8667fa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5', 'volume_size': 1} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1222802209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74c58c2a-c6b0-49eb-8001-f8c4a8667fa5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3ddb0c9a2ad349d2b26b05c8945e04ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:04:26Z,use_quota=True,user_id='947a5e64e60643ddaf1b2b4ebcc779fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Creating volume 74c58c2a-c6b0-49eb-8001-f8c4a8667fa5 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:04:26 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:26 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5 1073741824 Sep 04 19:04:26 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:26 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5 1073741824" returned: 0 in 0.545s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:26 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5 Sep 04 19:04:26 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:26 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5" returned: 0 in 0.280s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:04:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f678148-02d5-45dc-b1b5-8b5ce14e176c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf9d6ef-d99a-4626-b557-c3e0ae600d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:27 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Volume volume-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5 (74c58c2a-c6b0-49eb-8001-f8c4a8667fa5): created successfully Sep 04 19:04:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edf9d6ef-d99a-4626-b557-c3e0ae600d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Flow 'volume_create_manager' (d867302d-578d-464b-a9d0-1cdf03d485e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:04:27 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-53c2a29f-f163-4504-86d2-97abc5a1b2ca req-b63bb142-f309-4c91-97a9-75fa6b8b2f75 tempest-VolumesGetTestJSON-301594113 None] Created volume successfully. Sep 04 19:04:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Acquiring lock "cinder-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:04:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Lock "cinder-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:04:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Acquiring lock "cinder-quobyte-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:04:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Lock "cinder-quobyte-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:04:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f148656d-13cb-4c88-99da-fab336bbd6d3]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:04:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:28 devstack sudo[89302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5 Sep 04 19:04:28 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:29 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5" returned: 0 in 0.418s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:29 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5 Sep 04 19:04:29 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:29 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5" returned: 0 in 0.262s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Lock "cinder-quobyte-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5" released by "delete_volume" :: held 0.731s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:04:29 devstack cinder-volume[87560]: DEBUG cinder.quota [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Created reservations ['fe4785d2-93c9-40cd-a345-ddf7fef3464c', 'ae12d200-587e-4318-88b4-23b2c850aa47', '02895d6d-9def-4024-98b3-ab1390e0861f', '5da75fb4-710f-463d-9b90-31b4ba9dbf46'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:04:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:04:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:04:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:29 devstack sudo[89310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:04:29 devstack sudo[89310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:29 devstack sudo[89310]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.247s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:29 devstack cinder-volume[87560]: DEBUG cinder.manager [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:04:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Deleted volume successfully. Sep 04 19:04:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-c0f6d14f-e165-4cfe-a898-94535c413cd5 req-a79ba687-300a-407c-bdad-0372ae0eec4f tempest-VolumesGetTestJSON-301594113 None] Lock "cinder-74c58c2a-c6b0-49eb-8001-f8c4a8667fa5-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Flow 'volume_create_manager' (1e98c648-6b14-4b2c-aed7-6527409e1001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce64f89b-e88f-4a1c-8ad8-0a48a64219c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce64f89b-e88f-4a1c-8ad8-0a48a64219c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1153321188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989ea966-545a-4843-ad86-76cfbeaa96cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496f21078f364fc093da4d00a32b502c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:04:34Z,use_quota=True,user_id='e55eb4ab612a45798b0ba8ef6bc790f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c6b4be-594d-48e4-90f2-b7942f063b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c6b4be-594d-48e4-90f2-b7942f063b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7993a9bc-1364-438f-931c-9099b71c0568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7993a9bc-1364-438f-931c-9099b71c0568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '989ea966-545a-4843-ad86-76cfbeaa96cb', 'volume_name': 'volume-989ea966-545a-4843-ad86-76cfbeaa96cb', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b743d2e-3c4c-4640-825b-abdbdf8db114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b743d2e-3c4c-4640-825b-abdbdf8db114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fc8186-6e3f-46eb-a347-36c71f88b5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:34 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Volume 989ea966-545a-4843-ad86-76cfbeaa96cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-989ea966-545a-4843-ad86-76cfbeaa96cb', 'volume_size': 1} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1153321188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=989ea966-545a-4843-ad86-76cfbeaa96cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='496f21078f364fc093da4d00a32b502c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:04:34Z,use_quota=True,user_id='e55eb4ab612a45798b0ba8ef6bc790f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Creating volume 989ea966-545a-4843-ad86-76cfbeaa96cb {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:04:34 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:04:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-989ea966-545a-4843-ad86-76cfbeaa96cb 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:34 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-989ea966-545a-4843-ad86-76cfbeaa96cb 1073741824 Sep 04 19:04:34 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:35 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-989ea966-545a-4843-ad86-76cfbeaa96cb 1073741824" returned: 0 in 0.632s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-989ea966-545a-4843-ad86-76cfbeaa96cb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:35 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-989ea966-545a-4843-ad86-76cfbeaa96cb Sep 04 19:04:35 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:35 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-989ea966-545a-4843-ad86-76cfbeaa96cb" returned: 0 in 0.328s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:04:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fc8186-6e3f-46eb-a347-36c71f88b5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-989ea966-545a-4843-ad86-76cfbeaa96cb', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d676cbb-5c7e-4af9-a3de-c80fdb8968fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:35 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Volume volume-989ea966-545a-4843-ad86-76cfbeaa96cb (989ea966-545a-4843-ad86-76cfbeaa96cb): created successfully Sep 04 19:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d676cbb-5c7e-4af9-a3de-c80fdb8968fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Flow 'volume_create_manager' (1e98c648-6b14-4b2c-aed7-6527409e1001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:04:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-471cb97f-9ecf-4d73-9a52-becf60efe551 tempest-AttachVolumeShelveTestJSON-353558496 None] Created volume successfully. Sep 04 19:04:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9c6b1f08-49a0-4bd1-b57b-5856998a4671 tempest-GroupSnapshotsTest-637712219 None] Group tempest-GroupSnapshotsTest-Group-968187599: creating Sep 04 19:04:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9c6b1f08-49a0-4bd1-b57b-5856998a4671 tempest-GroupSnapshotsTest-637712219 None] Group tempest-GroupSnapshotsTest-Group-968187599: created successfully Sep 04 19:04:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9c6b1f08-49a0-4bd1-b57b-5856998a4671 tempest-GroupSnapshotsTest-637712219 None] Create group completed successfully. Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Flow 'volume_create_manager' (6b83e437-848a-401e-8c35-fb1aaaa38220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10998eb-e808-4ea5-a1bc-969c8ff99d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10998eb-e808-4ea5-a1bc-969c8ff99d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1333867301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=69034662-b63f-428d-97d8-9f7f43f69807,host='devstack@QuobyteHD#QuobyteHD',id=ec80ce9c-b12f-4e5c-88f9-a868002265c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93671a37027049d4b8e21f76ea0878f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:04:44Z,use_quota=True,user_id='b08772b81cbb47df9024017152b62021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c53b6cb-8c2f-4d9a-95a8-a05a660a0125),volume_type_id=2c53b6cb-8c2f-4d9a-95a8-a05a660a0125)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176bdb0b-e1f4-4a67-9f3d-1c2cd62923b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (176bdb0b-e1f4-4a67-9f3d-1c2cd62923b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767ad61f-6e7c-4add-9b5d-9b6c41abaef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (767ad61f-6e7c-4add-9b5d-9b6c41abaef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec80ce9c-b12f-4e5c-88f9-a868002265c2', 'volume_name': 'volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6f3a33-3e20-4d6c-a7a3-f6d8ff470d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6f3a33-3e20-4d6c-a7a3-f6d8ff470d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e6876c-f70f-4c10-bee5-7282d80be969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:43 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Volume ec80ce9c-b12f-4e5c-88f9-a868002265c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2', 'volume_size': 1} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=69034662-b63f-428d-97d8-9f7f43f69807,created_at=2026-09-04T17:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1333867301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=69034662-b63f-428d-97d8-9f7f43f69807,host='devstack@QuobyteHD#QuobyteHD',id=ec80ce9c-b12f-4e5c-88f9-a868002265c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93671a37027049d4b8e21f76ea0878f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:04:44Z,use_quota=True,user_id='b08772b81cbb47df9024017152b62021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2c53b6cb-8c2f-4d9a-95a8-a05a660a0125),volume_type_id=2c53b6cb-8c2f-4d9a-95a8-a05a660a0125)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Creating volume ec80ce9c-b12f-4e5c-88f9-a868002265c2 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:04:43 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:04:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:43 devstack sudo[89358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 1073741824 Sep 04 19:04:43 devstack sudo[89358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:44 devstack sudo[89358]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 1073741824" returned: 0 in 0.552s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:44 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 Sep 04 19:04:44 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:44 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2" returned: 0 in 0.255s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:04:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13e6876c-f70f-4c10-bee5-7282d80be969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75522fc4-05e9-402a-ae8c-3a6814dbae32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:04:44 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Volume volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 (ec80ce9c-b12f-4e5c-88f9-a868002265c2): created successfully Sep 04 19:04:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75522fc4-05e9-402a-ae8c-3a6814dbae32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:04:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Flow 'volume_create_manager' (6b83e437-848a-401e-8c35-fb1aaaa38220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:04:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ab006ab4-9431-48cc-8f9f-c90938f3ebc9 tempest-GroupSnapshotsTest-637712219 None] Created volume successfully. Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:45 devstack sudo[89367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:04:45 devstack sudo[89367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:45 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] GroupSnapshot be40dd08-6c62-45e6-a4d7-a790db3cd16d: creating. Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] Group snapshot be40dd08-6c62-45e6-a4d7-a790db3cd16d: creating. {{(pid=87560) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] Creating offline snapshot 2de09cd8-51a4-42ea-abf4-98f3815aac9d of volume ec80ce9c-b12f-4e5c-88f9-a868002265c2 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5eebb1-a8ef-4b56-a5eb-3d5514a68508]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:45 devstack sudo[89367]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:04:45 devstack sudo[89369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 Sep 04 19:04:45 devstack sudo[89369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:45 devstack sudo[89369]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2" returned: 0 in 0.490s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:45 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d 1G Sep 04 19:04:45 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:46 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d 1G" returned: 0 in 0.453s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:46 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d Sep 04 19:04:46 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:46 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d" returned: 0 in 0.371s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:46 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d is being set with open permissions: ugo+rw: NotImplementedError Sep 04 19:04:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:46 devstack sudo[89387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d Sep 04 19:04:46 devstack sudo[89387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:46 devstack sudo[89387]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:47 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.info Sep 04 19:04:47 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:47 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.info" returned: 0 in 0.277s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:47 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 19:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:47 devstack sudo[89393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.info Sep 04 19:04:47 devstack sudo[89393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:47 devstack sudo[89393]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.info" returned: 0 in 0.380s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.364s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-cd7adfbb-3bc3-488d-b037-27d6efa754f2 tempest-GroupSnapshotsTest-637712219 None] group_snapshot be40dd08-6c62-45e6-a4d7-a790db3cd16d: created successfully Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.004s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "cinder-quobyte-2de09cd8-51a4-42ea-abf4-98f3815aac9d-36c15756-35c3-4209-9a71-e6018d34b7f3" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-2de09cd8-51a4-42ea-abf4-98f3815aac9d-36c15756-35c3-4209-9a71-e6018d34b7f3" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Creating volume 36c15756-35c3-4209-9a71-e6018d34b7f3 from snapshot 2de09cd8-51a4-42ea-abf4-98f3815aac9d {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "cinder-quobyte-36c15756-35c3-4209-9a71-e6018d34b7f3" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-36c15756-35c3-4209-9a71-e6018d34b7f3" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] snapshot: 2de09cd8-51a4-42ea-abf4-98f3815aac9d, volume: 36c15756-35c3-4209-9a71-e6018d34b7f3, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa719a7-a06f-493d-800a-204830a63881]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:04:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:49 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d Sep 04 19:04:49 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:50 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d" returned: 0 in 0.502s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:04:50 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[090d2373-e2c4-441e-973c-4688b9cf0252]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:04:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:50 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 Sep 04 19:04:50 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:50 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2" returned: 0 in 0.452s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 19:04:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 19:04:50 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Path /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36c15756-35c3-4209-9a71-e6018d34b7f3 not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 19:04:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36c15756-35c3-4209-9a71-e6018d34b7f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:50 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36c15756-35c3-4209-9a71-e6018d34b7f3 Sep 04 19:04:50 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:56 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36c15756-35c3-4209-9a71-e6018d34b7f3" returned: 0 in 6.019s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:56 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2, size 1024.00 MB, duration 6.02 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36c15756-35c3-4209-9a71-e6018d34b7f3 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:04:56 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Converted 1024.00 MB image at 170.10 MB/s Sep 04 19:04:56 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36c15756-35c3-4209-9a71-e6018d34b7f3 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 19:04:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36c15756-35c3-4209-9a71-e6018d34b7f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:56 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36c15756-35c3-4209-9a71-e6018d34b7f3 Sep 04 19:04:56 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:57 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36c15756-35c3-4209-9a71-e6018d34b7f3" returned: 0 in 0.335s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-36c15756-35c3-4209-9a71-e6018d34b7f3" released by "_copy_volume_from_snapshot" :: held 7.440s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:04:57 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=48,cinder:UPDATE=47,cinder:DELETE=5,cinder:INSERT=8 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:04:57 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=39,cinder:INSERT=10,cinder:UPDATE=42,cinder:DELETE=3 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:04:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-2de09cd8-51a4-42ea-abf4-98f3815aac9d-36c15756-35c3-4209-9a71-e6018d34b7f3" released by "_create_volume_from_snapshot" :: held 7.622s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:04:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.649s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-cc3a1fa8-9365-45c4-bb29-4f8ba2c7bbb4 tempest-GroupSnapshotsTest-637712219 None] Create group from source-snapshot-be40dd08-6c62-45e6-a4d7-a790db3cd16d completed successfully. Sep 04 19:04:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-090de07f-4a4a-4860-b361-9033a21684c6 req-e0d2e6cc-f4f3-4255-bd95-2ddb499cd079 tempest-AttachVolumeShelveTestJSON-353558496 None] No connector for attachment 996c10e7-f979-4cd8-996a-de3e5e656c9f; skipping storage backend terminate_connection call. {{(pid=87560) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 04 19:04:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-090de07f-4a4a-4860-b361-9033a21684c6 req-e0d2e6cc-f4f3-4255-bd95-2ddb499cd079 tempest-AttachVolumeShelveTestJSON-353558496 None] Deleting attachment 996c10e7-f979-4cd8-996a-de3e5e656c9f. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:04:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "cinder-quobyte-36c15756-35c3-4209-9a71-e6018d34b7f3" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:04:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-36c15756-35c3-4209-9a71-e6018d34b7f3" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:04:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed9e20fc-fd15-4b4b-827b-cbad603d3431]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:04:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36c15756-35c3-4209-9a71-e6018d34b7f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:58 devstack sudo[89470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36c15756-35c3-4209-9a71-e6018d34b7f3 Sep 04 19:04:58 devstack sudo[89470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:58 devstack sudo[89470]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36c15756-35c3-4209-9a71-e6018d34b7f3" returned: 0 in 0.624s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36c15756-35c3-4209-9a71-e6018d34b7f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:58 devstack sudo[89478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36c15756-35c3-4209-9a71-e6018d34b7f3 Sep 04 19:04:58 devstack sudo[89478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:59 devstack sudo[89478]: pam_unix(sudo:session): session closed for user root Sep 04 19:04:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36c15756-35c3-4209-9a71-e6018d34b7f3" returned: 0 in 0.310s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:04:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-36c15756-35c3-4209-9a71-e6018d34b7f3" released by "delete_volume" :: held 1.052s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:04:59 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Created reservations ['dd12d8d5-7b96-4bb8-a89c-6d806b77ceac'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:04:59 devstack cinder-volume[87560]: WARNING cinder.quota [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-80787594 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-80787594, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:04:59 devstack cinder-volume[87560]: WARNING cinder.quota [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-80787594 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-80787594, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:04:59 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Created reservations ['335c80c9-59c9-442f-a565-1bb93e408622', 'cc116cf0-3dd5-44eb-a644-5422d84fdf86', 'c4c89bff-f6f8-4dbf-bb6d-8f435a97e4e0', '32a06f74-009d-4865-83a6-fc3f259e03e5'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:04:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:04:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:04:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:04:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:04:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:04:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:04:59 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:04:59 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:04:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] group_snapshot be40dd08-6c62-45e6-a4d7-a790db3cd16d: deleting Sep 04 19:05:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] group_snapshot be40dd08-6c62-45e6-a4d7-a790db3cd16d: deleting {{(pid=87560) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 19:05:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "cinder-quobyte-ec80ce9c-b12f-4e5c-88f9-a868002265c2" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:05:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-ec80ce9c-b12f-4e5c-88f9-a868002265c2" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:05:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "cinder-quobyte-2de09cd8-51a4-42ea-abf4-98f3815aac9d" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:05:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-2de09cd8-51a4-42ea-abf4-98f3815aac9d" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:05:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] Deleting offline snapshot 2de09cd8-51a4-42ea-abf4-98f3815aac9d of volume ec80ce9c-b12f-4e5c-88f9-a868002265c2 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:05:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] snapshot_file for this snap is: volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:05:00 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d23c0ef-1016-4c64-bea6-a7769e2acb57]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:05:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:00 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.687s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:00 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:05:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-296ee0ca-101b-4331-ad03-8d59545d2c14 tempest-GroupSnapshotsTest-637712219 None] Delete group completed successfully. Sep 04 19:05:00 devstack sudo[89489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d Sep 04 19:05:00 devstack sudo[89489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:00 devstack sudo[89489]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d" returned: 0 in 0.674s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:05:00 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[894e4232-dc47-443c-9006-69225b6218b0]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:05:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:01 devstack sudo[89504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 Sep 04 19:05:01 devstack sudo[89504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:01 devstack sudo[89504]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2" returned: 0 in 0.735s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:01 devstack sudo[89518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d Sep 04 19:05:01 devstack sudo[89518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:02 devstack sudo[89518]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d" returned: 0 in 0.475s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:02 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d Sep 04 19:05:02 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:02 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2.2de09cd8-51a4-42ea-abf4-98f3815aac9d" returned: 0 in 0.262s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-2de09cd8-51a4-42ea-abf4-98f3815aac9d" released by "_delete_snapshot" :: held 2.351s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:05:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-ec80ce9c-b12f-4e5c-88f9-a868002265c2" released by "delete_snapshot" :: held 2.398s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:05:02 devstack cinder-volume[87560]: WARNING cinder.quota [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-80787594 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-80787594, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:05:02 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] Created reservations ['979016a5-93e1-48e4-a8b0-597b30dbbf9f', '91c52fed-4ff5-4747-bc09-88306fcbd1b0', '756b2923-bd30-438a-a102-fcd2b3b93f00', '3a0b5bc1-bfa9-48df-a1cb-4bc488cec087'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:05:02 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-242c21ad-6ca2-401c-9ff2-564124e7f78f tempest-GroupSnapshotsTest-637712219 None] group_snapshot be40dd08-6c62-45e6-a4d7-a790db3cd16d: deleted successfully Sep 04 19:05:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "cinder-quobyte-ec80ce9c-b12f-4e5c-88f9-a868002265c2" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:05:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-ec80ce9c-b12f-4e5c-88f9-a868002265c2" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:05:04 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49e7641-a8aa-4b29-b79c-fe04fb24d9bb]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:05:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:04 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 Sep 04 19:05:04 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:04 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2" returned: 0 in 0.490s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:04 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2 Sep 04 19:05:04 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:04 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec80ce9c-b12f-4e5c-88f9-a868002265c2" returned: 0 in 0.324s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-ec80ce9c-b12f-4e5c-88f9-a868002265c2" released by "delete_volume" :: held 0.911s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:05:05 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] Created reservations ['e6e9a5e9-aef9-4035-bd2f-16008da8ca41'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:05:05 devstack cinder-volume[87560]: WARNING cinder.db.api [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-80787594'] Sep 04 19:05:05 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] Created reservations ['5c738d4d-220e-48de-85f3-ac69068abc02', '2d664725-f73d-4536-ab4d-5328c3032c3f', '816f25db-fd39-4dca-8770-8b1cd0f36c2c', 'a4092e66-9172-42c7-aa7f-f0429d8cf97a'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:05:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:05:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:05:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:05 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:05:05 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:05 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:05:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Flow 'volume_create_manager' (dbcc4fd2-3aa6-45e7-a85c-b2084f6dacd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:05:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84cf0b05-c489-498b-af0e-03cc51af4891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84cf0b05-c489-498b-af0e-03cc51af4891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-28485174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8683c3b3-bbe4-484f-886f-b399c5bb8689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e85f2768fdc4f0e9da678d770ef724b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:05:06Z,use_quota=True,user_id='c021b6c105fc461dba4f33acb0053f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab6a910-c6be-41a8-8399-8f3e67a775a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dab6a910-c6be-41a8-8399-8f3e67a775a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb8ac9f-a5fb-42a2-9ee2-a3e3ef3e53b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb8ac9f-a5fb-42a2-9ee2-a3e3ef3e53b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8683c3b3-bbe4-484f-886f-b399c5bb8689', 'volume_name': 'volume-8683c3b3-bbe4-484f-886f-b399c5bb8689', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bef5283-1e74-4da2-9707-f6bc144740b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bef5283-1e74-4da2-9707-f6bc144740b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:06 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e167f44-1da1-4808-8055-f2ba7c22b4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:06 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Volume 8683c3b3-bbe4-484f-886f-b399c5bb8689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8683c3b3-bbe4-484f-886f-b399c5bb8689', 'volume_size': 1} Sep 04 19:05:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:05:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-28485174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8683c3b3-bbe4-484f-886f-b399c5bb8689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e85f2768fdc4f0e9da678d770ef724b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:05:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:05:06Z,use_quota=True,user_id='c021b6c105fc461dba4f33acb0053f74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:05:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Creating volume 8683c3b3-bbe4-484f-886f-b399c5bb8689 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:05:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:05:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:05:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:05:06 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:05:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8683c3b3-bbe4-484f-886f-b399c5bb8689 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.762s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:06 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:05:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-37bc9a20-f2f8-4e40-b4fc-767967a15734 tempest-GroupSnapshotsTest-637712219 None] Delete group completed successfully. Sep 04 19:05:06 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8683c3b3-bbe4-484f-886f-b399c5bb8689 1073741824 Sep 04 19:05:06 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:07 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8683c3b3-bbe4-484f-886f-b399c5bb8689 1073741824" returned: 0 in 1.091s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8683c3b3-bbe4-484f-886f-b399c5bb8689 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:07 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8683c3b3-bbe4-484f-886f-b399c5bb8689 Sep 04 19:05:07 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2e553b44-a5cb-44e2-bb77-126e0268984a tempest-GroupSnapshotsTest-637712219 None] Group tempest-GroupSnapshotsTest-Group-1561599860: creating Sep 04 19:05:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2e553b44-a5cb-44e2-bb77-126e0268984a tempest-GroupSnapshotsTest-637712219 None] Group tempest-GroupSnapshotsTest-Group-1561599860: created successfully Sep 04 19:05:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2e553b44-a5cb-44e2-bb77-126e0268984a tempest-GroupSnapshotsTest-637712219 None] Create group completed successfully. Sep 04 19:05:07 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8683c3b3-bbe4-484f-886f-b399c5bb8689" returned: 0 in 0.642s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:05:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.855s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e167f44-1da1-4808-8055-f2ba7c22b4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8683c3b3-bbe4-484f-886f-b399c5bb8689', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bdc098-5187-4e62-81c0-d1e1eb5efb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:07 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Volume volume-8683c3b3-bbe4-484f-886f-b399c5bb8689 (8683c3b3-bbe4-484f-886f-b399c5bb8689): created successfully Sep 04 19:05:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8bdc098-5187-4e62-81c0-d1e1eb5efb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Flow 'volume_create_manager' (dbcc4fd2-3aa6-45e7-a85c-b2084f6dacd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:05:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b8117ee9-af3b-4b24-bc06-b5223e0ae473 tempest-TaggedAttachmentsTest-1575391100 None] Created volume successfully. Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Flow 'volume_create_manager' (595e1319-442f-42ca-a7ec-21be7854d009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35e1d9f-32a7-40f1-899b-0d2456b15fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35e1d9f-32a7-40f1-899b-0d2456b15fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1823906644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54c2701e-5960-4913-81b1-3d87bdfb4167,host='devstack@QuobyteHD#QuobyteHD',id=78215256-0bd9-40c2-9c6d-7b998c367eac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93671a37027049d4b8e21f76ea0878f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:05:10Z,use_quota=True,user_id='b08772b81cbb47df9024017152b62021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a053326-2cd8-4daf-a868-bd1aba6101e8),volume_type_id=7a053326-2cd8-4daf-a868-bd1aba6101e8)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d19f13ca-8562-49da-825c-673cb8207f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d19f13ca-8562-49da-825c-673cb8207f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e4f32e-f6ff-4cad-b566-ecd87ae76f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e4f32e-f6ff-4cad-b566-ecd87ae76f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78215256-0bd9-40c2-9c6d-7b998c367eac', 'volume_name': 'volume-78215256-0bd9-40c2-9c6d-7b998c367eac', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3213608d-df53-4eb1-97fd-e8b7d6177d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3213608d-df53-4eb1-97fd-e8b7d6177d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f085a8f-d31a-4559-92e4-187352f8a807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:09 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Volume 78215256-0bd9-40c2-9c6d-7b998c367eac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78215256-0bd9-40c2-9c6d-7b998c367eac', 'volume_size': 1} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=54c2701e-5960-4913-81b1-3d87bdfb4167,created_at=2026-09-04T17:05:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1823906644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54c2701e-5960-4913-81b1-3d87bdfb4167,host='devstack@QuobyteHD#QuobyteHD',id=78215256-0bd9-40c2-9c6d-7b998c367eac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93671a37027049d4b8e21f76ea0878f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:05:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:05:10Z,use_quota=True,user_id='b08772b81cbb47df9024017152b62021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a053326-2cd8-4daf-a868-bd1aba6101e8),volume_type_id=7a053326-2cd8-4daf-a868-bd1aba6101e8)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Creating volume 78215256-0bd9-40c2-9c6d-7b998c367eac {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:05:09 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:05:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:10 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac 1073741824 Sep 04 19:05:10 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:10 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac 1073741824" returned: 0 in 0.766s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:10 devstack sudo[89659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac Sep 04 19:05:10 devstack sudo[89659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:11 devstack sudo[89659]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac" returned: 0 in 0.475s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] <== create_volume: return (1322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:05:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.327s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f085a8f-d31a-4559-92e4-187352f8a807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78215256-0bd9-40c2-9c6d-7b998c367eac', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cebbc34-76fd-4ccb-b182-cc63a82f9645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:11 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Volume volume-78215256-0bd9-40c2-9c6d-7b998c367eac (78215256-0bd9-40c2-9c6d-7b998c367eac): created successfully Sep 04 19:05:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cebbc34-76fd-4ccb-b182-cc63a82f9645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Flow 'volume_create_manager' (595e1319-442f-42ca-a7ec-21be7854d009) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:05:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8fb7c6e4-90d9-4d73-8d61-3305dbefe7f9 tempest-GroupSnapshotsTest-637712219 None] Created volume successfully. Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Flow 'volume_create_manager' (42845d93-3f4e-499c-850c-39cf47ebbb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a23ddfc-5918-48d1-817e-d85111c0a013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a23ddfc-5918-48d1-817e-d85111c0a013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-939161957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54c2701e-5960-4913-81b1-3d87bdfb4167,host='devstack@QuobyteHD#QuobyteHD',id=357d1551-effa-4695-ad22-6306202d9261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93671a37027049d4b8e21f76ea0878f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:05:13Z,use_quota=True,user_id='b08772b81cbb47df9024017152b62021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a053326-2cd8-4daf-a868-bd1aba6101e8),volume_type_id=7a053326-2cd8-4daf-a868-bd1aba6101e8)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b794b02-33a6-406d-8e4e-37f1f3231c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b794b02-33a6-406d-8e4e-37f1f3231c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04806f06-1cab-4890-b133-87de1f1fff5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04806f06-1cab-4890-b133-87de1f1fff5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '357d1551-effa-4695-ad22-6306202d9261', 'volume_name': 'volume-357d1551-effa-4695-ad22-6306202d9261', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7118a7b0-84a1-482e-bcb1-97e82c03f72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7118a7b0-84a1-482e-bcb1-97e82c03f72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b735b4-e4b3-41fa-bd6a-d0aff83b24ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:13 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Volume 357d1551-effa-4695-ad22-6306202d9261: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-357d1551-effa-4695-ad22-6306202d9261', 'volume_size': 1} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=54c2701e-5960-4913-81b1-3d87bdfb4167,created_at=2026-09-04T17:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-939161957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=54c2701e-5960-4913-81b1-3d87bdfb4167,host='devstack@QuobyteHD#QuobyteHD',id=357d1551-effa-4695-ad22-6306202d9261,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93671a37027049d4b8e21f76ea0878f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:05:13Z,use_quota=True,user_id='b08772b81cbb47df9024017152b62021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7a053326-2cd8-4daf-a868-bd1aba6101e8),volume_type_id=7a053326-2cd8-4daf-a868-bd1aba6101e8)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Creating volume 357d1551-effa-4695-ad22-6306202d9261 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:05:13 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:05:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:13 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261 1073741824 Sep 04 19:05:13 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:14 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261 1073741824" returned: 0 in 1.239s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:14 devstack sudo[89748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261 Sep 04 19:05:14 devstack sudo[89748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:15 devstack sudo[89748]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261" returned: 0 in 0.635s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:05:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b735b4-e4b3-41fa-bd6a-d0aff83b24ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-357d1551-effa-4695-ad22-6306202d9261', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3077aeb3-842a-4312-a8bd-b98ad6c64e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Volume volume-357d1551-effa-4695-ad22-6306202d9261 (357d1551-effa-4695-ad22-6306202d9261): created successfully Sep 04 19:05:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3077aeb3-842a-4312-a8bd-b98ad6c64e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Flow 'volume_create_manager' (42845d93-3f4e-499c-850c-39cf47ebbb39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:05:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-76138b1c-f289-4f9f-a91d-09a79d0c9505 tempest-GroupSnapshotsTest-637712219 None] Created volume successfully. Sep 04 19:05:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-466ffa95-9b8b-4aec-a913-961dfeb88cb4 tempest-GroupSnapshotsTest-637712219 None] Update group completed successfully. Sep 04 19:05:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-229dcee1-fac4-4ac3-abd7-997e1a7ec06c tempest-GroupSnapshotsTest-637712219 None] Update group completed successfully. Sep 04 19:05:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-21dd69b4-80b1-417a-901b-fdc5fdbf79bf tempest-GroupSnapshotsTest-637712219 None] Update group completed successfully. Sep 04 19:05:20 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b64ecf34-ed01-4148-b9a4-07408b2b6a59 tempest-GroupSnapshotsTest-637712219 None] Update group completed successfully. Sep 04 19:05:22 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] GroupSnapshot b41818c1-5789-4f78-a584-6ce4af400527: creating. Sep 04 19:05:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Group snapshot b41818c1-5789-4f78-a584-6ce4af400527: creating. {{(pid=87560) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 19:05:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Creating offline snapshot 8c6b00fa-5c0c-4981-a0ec-dc3d94d680de of volume 78215256-0bd9-40c2-9c6d-7b998c367eac {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:05:22 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[16a8908c-b536-4b08-9fe0-bab6108035e3]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:05:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:22 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac Sep 04 19:05:22 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:23 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac" returned: 0 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:23 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de 1G Sep 04 19:05:23 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:23 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de 1G" returned: 0 in 0.716s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78215256-0bd9-40c2-9c6d-7b998c367eac -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:23 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78215256-0bd9-40c2-9c6d-7b998c367eac -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de Sep 04 19:05:23 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:24 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78215256-0bd9-40c2-9c6d-7b998c367eac -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de" returned: 0 in 0.286s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:24 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de is being set with open permissions: ugo+rw: NotImplementedError Sep 04 19:05:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:24 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de Sep 04 19:05:24 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:24 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de" returned: 0 in 0.247s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:24 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.info Sep 04 19:05:24 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:24 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.info" returned: 0 in 0.307s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:24 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 19:05:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:24 devstack sudo[89950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.info Sep 04 19:05:24 devstack sudo[89950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:25 devstack sudo[89950]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.info" returned: 0 in 0.358s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.399s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Creating offline snapshot f683a5f1-0bef-4a73-866c-89a3164924e4 of volume 357d1551-effa-4695-ad22-6306202d9261 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:05:25 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd59684b-6db1-43e8-a105-863bea77b438]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:05:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:25 devstack sudo[89953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261 Sep 04 19:05:25 devstack sudo[89953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:25 devstack sudo[89953]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261" returned: 0 in 0.452s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:25 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4 1G Sep 04 19:05:25 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:26 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4 1G" returned: 0 in 0.518s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-357d1551-effa-4695-ad22-6306202d9261 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:26 devstack sudo[89963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-357d1551-effa-4695-ad22-6306202d9261 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4 Sep 04 19:05:26 devstack sudo[89963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:26 devstack sudo[89963]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-357d1551-effa-4695-ad22-6306202d9261 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4" returned: 0 in 0.353s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:26 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 19:05:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:26 devstack sudo[89969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4 Sep 04 19:05:26 devstack sudo[89969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:26 devstack sudo[89969]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4" returned: 0 in 0.409s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:27 devstack sudo[89973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.info Sep 04 19:05:27 devstack sudo[89973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:27 devstack sudo[89973]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.info" returned: 0 in 0.316s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:27 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 19:05:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:27 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.info Sep 04 19:05:27 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:27 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.info" returned: 0 in 0.335s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.536s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:27 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-af82700f-3d6a-4fc5-918b-34f57f1ec014 tempest-GroupSnapshotsTest-637712219 None] group_snapshot b41818c1-5789-4f78-a584-6ce4af400527: created successfully Sep 04 19:05:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] group_snapshot b41818c1-5789-4f78-a584-6ce4af400527: deleting Sep 04 19:05:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] group_snapshot b41818c1-5789-4f78-a584-6ce4af400527: deleting {{(pid=87560) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 19:05:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "cinder-quobyte-78215256-0bd9-40c2-9c6d-7b998c367eac" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:05:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-78215256-0bd9-40c2-9c6d-7b998c367eac" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:05:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "cinder-quobyte-8c6b00fa-5c0c-4981-a0ec-dc3d94d680de" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:05:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-8c6b00fa-5c0c-4981-a0ec-dc3d94d680de" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:05:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Deleting offline snapshot 8c6b00fa-5c0c-4981-a0ec-dc3d94d680de of volume 78215256-0bd9-40c2-9c6d-7b998c367eac {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:05:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] snapshot_file for this snap is: volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:05:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[86907096-2c90-4ce2-ba4b-f35b5cf93e98]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:05:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:28 devstack sudo[89981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de Sep 04 19:05:28 devstack sudo[89981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:28 devstack sudo[89981]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de" returned: 0 in 0.484s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78215256-0bd9-40c2-9c6d-7b998c367eac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:05:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[14489cc5-d9e9-4c3e-aba4-8d262b92e96c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:05:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:29 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac Sep 04 19:05:29 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:29 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac" returned: 0 in 0.433s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:29 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de Sep 04 19:05:29 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:29 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de" returned: 0 in 0.371s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:29 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de Sep 04 19:05:29 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:30 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac.8c6b00fa-5c0c-4981-a0ec-dc3d94d680de" returned: 0 in 0.274s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-8c6b00fa-5c0c-4981-a0ec-dc3d94d680de" released by "_delete_snapshot" :: held 1.688s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-78215256-0bd9-40c2-9c6d-7b998c367eac" released by "delete_snapshot" :: held 1.718s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "cinder-quobyte-357d1551-effa-4695-ad22-6306202d9261" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-357d1551-effa-4695-ad22-6306202d9261" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "cinder-quobyte-f683a5f1-0bef-4a73-866c-89a3164924e4" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-f683a5f1-0bef-4a73-866c-89a3164924e4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Deleting offline snapshot f683a5f1-0bef-4a73-866c-89a3164924e4 of volume 357d1551-effa-4695-ad22-6306202d9261 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] snapshot_file for this snap is: volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7297cca-8fac-4d2c-9501-3f6eccfcd939]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:30 devstack sudo[90002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4 Sep 04 19:05:30 devstack sudo[90002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:30 devstack sudo[90002]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4" returned: 0 in 0.341s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-357d1551-effa-4695-ad22-6306202d9261(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cff849f-5aac-43b0-a917-2a74fe4f1202]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:30 devstack sudo[90007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261 Sep 04 19:05:30 devstack sudo[90007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:30 devstack sudo[90007]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261" returned: 0 in 0.360s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:30 devstack sudo[90012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4 Sep 04 19:05:30 devstack sudo[90012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:31 devstack sudo[90012]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4" returned: 0 in 0.350s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:31 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4 Sep 04 19:05:31 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:31 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261.f683a5f1-0bef-4a73-866c-89a3164924e4" returned: 0 in 0.239s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-f683a5f1-0bef-4a73-866c-89a3164924e4" released by "_delete_snapshot" :: held 1.369s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:05:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-357d1551-effa-4695-ad22-6306202d9261" released by "delete_snapshot" :: held 1.396s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:05:31 devstack cinder-volume[87560]: WARNING cinder.quota [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2061764869 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2061764869, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:05:31 devstack cinder-volume[87560]: WARNING cinder.quota [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2061764869 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2061764869, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:05:31 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Created reservations ['a74f41a2-6890-435b-9ca1-fa5f8cfc318c', '8817ea95-7f9a-4094-a803-70f845083a23', '423de272-f94b-4f18-b437-2e8efe2f7fc6', 'a6202bcc-730a-47ab-9aff-9eb50c3a3d9e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:05:31 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] Created reservations ['e83fd25b-29fb-4d46-8e5f-6d4b72903281', '3a7bdec8-38f1-4df9-9492-8e57f796818c', '6e0e9f5d-25bd-45ca-87d0-aba843b3bfc4', '970ff34c-2936-4831-9f88-8bccbc729725'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:05:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8ee564c6-5aed-42d3-835e-42cde26b7b07 tempest-GroupSnapshotsTest-637712219 None] group_snapshot b41818c1-5789-4f78-a584-6ce4af400527: deleted successfully Sep 04 19:05:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "cinder-quobyte-357d1551-effa-4695-ad22-6306202d9261" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:05:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-357d1551-effa-4695-ad22-6306202d9261" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:05:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdab8cf-265a-4eac-a58d-957e748c5c65]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:05:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:32 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261 Sep 04 19:05:32 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:32 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261" returned: 0 in 0.362s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:32 devstack sudo[90026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261 Sep 04 19:05:32 devstack sudo[90026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:32 devstack sudo[90026]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-357d1551-effa-4695-ad22-6306202d9261" returned: 0 in 0.232s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-357d1551-effa-4695-ad22-6306202d9261" released by "delete_volume" :: held 0.660s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:05:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "cinder-quobyte-78215256-0bd9-40c2-9c6d-7b998c367eac" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:05:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-78215256-0bd9-40c2-9c6d-7b998c367eac" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:05:33 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a1411d-1963-4a6b-836c-822821e22a12]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:05:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:33 devstack sudo[90029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac Sep 04 19:05:33 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:33 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac" returned: 0 in 0.348s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:33 devstack sudo[90034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac Sep 04 19:05:33 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:33 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-78215256-0bd9-40c2-9c6d-7b998c367eac" returned: 0 in 0.295s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-78215256-0bd9-40c2-9c6d-7b998c367eac" released by "delete_volume" :: held 0.700s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:05:33 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Created reservations ['ca68d0e4-e0d5-43d9-a02a-924bec112cc6'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:05:33 devstack cinder-volume[87560]: WARNING cinder.quota [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2061764869 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2061764869, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:05:33 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Created reservations ['540f469c-474c-4575-abdf-d41bcfa51164', 'ce980148-d3d8-4f4a-9c73-4ba25dcc54f2', 'dcad82fb-5932-4a72-8136-9682a18cf9c8', 'f8ea0bbb-b928-43c0-af16-d695f507364c'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:05:33 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Created reservations ['326d6e12-84ef-4ba3-8fd2-a289c4ca0201', 'd57eb00e-ce6d-4a16-9d3d-80ceac5a3051', 'a5bb4d58-eab3-4199-8189-c80c83a76f79', '1ff38679-c6f3-42ec-b6af-eeb07d534419'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:34 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:05:34 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:34 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.303s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:05:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-052dc19b-35e8-478f-b4cd-c0d485e2c851 tempest-GroupSnapshotsTest-637712219 None] Delete group completed successfully. Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Flow 'volume_create_manager' (722f5c07-0dd1-40cf-b487-0dacc83334f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd4b6e8-aad2-4081-a833-60763277b330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cd4b6e8-aad2-4081-a833-60763277b330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-879823186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27db1e1cc30f4385a9d94c2acca66893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:05:35Z,use_quota=True,user_id='191fd840707244f8aa95a2379e85d05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243f4071-653e-4b6f-8364-c7160162d4a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243f4071-653e-4b6f-8364-c7160162d4a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3120a652-f2c7-4974-9c79-e798ef8ccb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3120a652-f2c7-4974-9c79-e798ef8ccb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256', 'volume_name': 'volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d089f9ed-aaa2-41c3-9e52-ef139ac44142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d089f9ed-aaa2-41c3-9e52-ef139ac44142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579b24c5-75d6-4929-80fc-2f2fbb81a999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:34 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Volume ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256', 'volume_size': 1} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-879823186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27db1e1cc30f4385a9d94c2acca66893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:05:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:05:35Z,use_quota=True,user_id='191fd840707244f8aa95a2379e85d05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Creating volume ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:05:34 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:05:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:34 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256 1073741824 Sep 04 19:05:34 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6774d6c9-c0e0-4068-9d8e-337d6944dc6d tempest-GroupSnapshotsTest-637712219 None] Group tempest-GroupSnapshotsTest-Group-1698831193: creating Sep 04 19:05:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6774d6c9-c0e0-4068-9d8e-337d6944dc6d tempest-GroupSnapshotsTest-637712219 None] Group tempest-GroupSnapshotsTest-Group-1698831193: created successfully Sep 04 19:05:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6774d6c9-c0e0-4068-9d8e-337d6944dc6d tempest-GroupSnapshotsTest-637712219 None] Create group completed successfully. Sep 04 19:05:35 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256 1073741824" returned: 0 in 0.607s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:35 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256 Sep 04 19:05:35 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:35 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256" returned: 0 in 0.276s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:05:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (579b24c5-75d6-4929-80fc-2f2fbb81a999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9c02ad-0433-4bb6-91f3-f981be70339e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:35 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Volume volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256 (ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256): created successfully Sep 04 19:05:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c9c02ad-0433-4bb6-91f3-f981be70339e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Flow 'volume_create_manager' (722f5c07-0dd1-40cf-b487-0dacc83334f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:05:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-85c84ab1-d073-4fd0-ad1d-ca663648e6d3 tempest-ServerActionsTestOtherA-1479936215 None] Created volume successfully. Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Flow 'volume_create_manager' (30289b11-3c6c-4271-a9ba-3b63dd66a00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaad99f4-6ca7-4a48-8af3-7b12258819a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaad99f4-6ca7-4a48-8af3-7b12258819a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2020778563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=de21a41b-1100-497a-a6df-51e9df15c33b,host='devstack@QuobyteHD#QuobyteHD',id=37a40244-3925-44c0-b9c3-72b4554a8f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93671a37027049d4b8e21f76ea0878f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:05:37Z,use_quota=True,user_id='b08772b81cbb47df9024017152b62021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ba9160-f775-4938-940e-371d9ab8fcf8),volume_type_id=c6ba9160-f775-4938-940e-371d9ab8fcf8)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3e34e7-d743-4d66-b815-e73cbf04e384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f3e34e7-d743-4d66-b815-e73cbf04e384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3cbdeb1-680e-4d69-aea6-2c3a3cdb099e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3cbdeb1-680e-4d69-aea6-2c3a3cdb099e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37a40244-3925-44c0-b9c3-72b4554a8f8a', 'volume_name': 'volume-37a40244-3925-44c0-b9c3-72b4554a8f8a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449ea38e-168f-4f11-982a-4ebdde51e159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (449ea38e-168f-4f11-982a-4ebdde51e159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27e8958-2285-44d3-a07f-0efc2f0ec96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:37 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Volume 37a40244-3925-44c0-b9c3-72b4554a8f8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37a40244-3925-44c0-b9c3-72b4554a8f8a', 'volume_size': 1} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=de21a41b-1100-497a-a6df-51e9df15c33b,created_at=2026-09-04T17:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2020778563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=de21a41b-1100-497a-a6df-51e9df15c33b,host='devstack@QuobyteHD#QuobyteHD',id=37a40244-3925-44c0-b9c3-72b4554a8f8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93671a37027049d4b8e21f76ea0878f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:05:37Z,use_quota=True,user_id='b08772b81cbb47df9024017152b62021',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c6ba9160-f775-4938-940e-371d9ab8fcf8),volume_type_id=c6ba9160-f775-4938-940e-371d9ab8fcf8)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Creating volume 37a40244-3925-44c0-b9c3-72b4554a8f8a {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:05:37 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:37 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a 1073741824 Sep 04 19:05:37 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:37 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a 1073741824" returned: 0 in 0.574s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:37 devstack sudo[90084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a Sep 04 19:05:37 devstack sudo[90084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:38 devstack sudo[90084]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a" returned: 0 in 0.273s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:05:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27e8958-2285-44d3-a07f-0efc2f0ec96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37a40244-3925-44c0-b9c3-72b4554a8f8a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ebf8d4-6704-40e6-8cca-911f08a12581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:05:38 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Volume volume-37a40244-3925-44c0-b9c3-72b4554a8f8a (37a40244-3925-44c0-b9c3-72b4554a8f8a): created successfully Sep 04 19:05:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4ebf8d4-6704-40e6-8cca-911f08a12581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:05:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Flow 'volume_create_manager' (30289b11-3c6c-4271-a9ba-3b63dd66a00c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:05:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ee827f6c-3b03-4282-b990-73e83b9a8547 tempest-GroupSnapshotsTest-637712219 None] Created volume successfully. Sep 04 19:05:40 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] GroupSnapshot a74a5af1-035b-4683-9b78-a1c7af6317e9: creating. Sep 04 19:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] Group snapshot a74a5af1-035b-4683-9b78-a1c7af6317e9: creating. {{(pid=87560) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 19:05:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] Creating offline snapshot 2bf94eb1-102f-44a5-ae12-1fd1488fb699 of volume 37a40244-3925-44c0-b9c3-72b4554a8f8a {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:05:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bc4598-27fc-446c-8fad-47d22071d653]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:05:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:40 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a Sep 04 19:05:40 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:40 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a" returned: 0 in 0.513s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:40 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699 1G Sep 04 19:05:40 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:41 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699 1G" returned: 0 in 0.544s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a40244-3925-44c0-b9c3-72b4554a8f8a -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:41 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a40244-3925-44c0-b9c3-72b4554a8f8a -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699 Sep 04 19:05:41 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:41 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37a40244-3925-44c0-b9c3-72b4554a8f8a -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699" returned: 0 in 0.408s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:41 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 19:05:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:41 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699 Sep 04 19:05:41 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:41 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699" returned: 0 in 0.358s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:42 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.info Sep 04 19:05:42 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:42 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.info" returned: 0 in 0.331s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:42 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 19:05:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:42 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.info Sep 04 19:05:42 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:42 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.info" returned: 0 in 0.309s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.601s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d3674178-9ae5-4ccb-8edd-d8883d0e80b6 tempest-GroupSnapshotsTest-637712219 None] group_snapshot a74a5af1-035b-4683-9b78-a1c7af6317e9: created successfully Sep 04 19:05:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] group_snapshot a74a5af1-035b-4683-9b78-a1c7af6317e9: deleting Sep 04 19:05:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] group_snapshot a74a5af1-035b-4683-9b78-a1c7af6317e9: deleting {{(pid=87560) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 19:05:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "cinder-quobyte-37a40244-3925-44c0-b9c3-72b4554a8f8a" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:05:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-37a40244-3925-44c0-b9c3-72b4554a8f8a" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:05:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "cinder-quobyte-2bf94eb1-102f-44a5-ae12-1fd1488fb699" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:05:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-2bf94eb1-102f-44a5-ae12-1fd1488fb699" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:05:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] Deleting offline snapshot 2bf94eb1-102f-44a5-ae12-1fd1488fb699 of volume 37a40244-3925-44c0-b9c3-72b4554a8f8a {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:05:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] snapshot_file for this snap is: volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:05:43 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a396f9-e6c2-4d03-bcda-76327a36bc90]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:05:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:44 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699 Sep 04 19:05:44 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Acquiring lock "cinder-989ea966-545a-4843-ad86-76cfbeaa96cb-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:05:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Lock "cinder-989ea966-545a-4843-ad86-76cfbeaa96cb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:05:44 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699" returned: 0 in 0.654s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Acquiring lock "cinder-quobyte-989ea966-545a-4843-ad86-76cfbeaa96cb" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:05:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37a40244-3925-44c0-b9c3-72b4554a8f8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:05:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[16eea678-c998-4170-976d-aa1fab61e0af]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:05:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Lock "cinder-quobyte-989ea966-545a-4843-ad86-76cfbeaa96cb" acquired by "delete_volume" :: waited 0.074s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:05:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b44972c-c430-4354-89e2-b7ba58d5d321]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:05:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-989ea966-545a-4843-ad86-76cfbeaa96cb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:44 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a Sep 04 19:05:44 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:44 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-989ea966-545a-4843-ad86-76cfbeaa96cb Sep 04 19:05:44 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:45 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:45 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-989ea966-545a-4843-ad86-76cfbeaa96cb" returned: 0 in 0.521s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-989ea966-545a-4843-ad86-76cfbeaa96cb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a" returned: 0 in 0.583s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:05:45 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-989ea966-545a-4843-ad86-76cfbeaa96cb Sep 04 19:05:45 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:45 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699 Sep 04 19:05:45 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:45 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:05:45 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:45 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:45 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.335s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-989ea966-545a-4843-ad86-76cfbeaa96cb" returned: 0 in 0.369s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 8 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Lock "cinder-quobyte-989ea966-545a-4843-ad86-76cfbeaa96cb" released by "delete_volume" :: held 0.955s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Created reservations ['55642105-69f3-467b-9008-a95052916446', 'dd6e1b5f-7d86-40eb-959c-aaf20c2f05a9', '42e807c9-55df-45cb-b188-27d015e26007', '21f9c2f1-7ab5-4b88-ae6a-b305258cc408'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:05:45 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699" returned: 0 in 0.590s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:45 devstack sudo[90258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699 Sep 04 19:05:45 devstack sudo[90258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:45 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:05:45 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:46 devstack sudo[90258]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a.2bf94eb1-102f-44a5-ae12-1fd1488fb699" returned: 0 in 0.297s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-2bf94eb1-102f-44a5-ae12-1fd1488fb699" released by "_delete_snapshot" :: held 2.335s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:05:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-37a40244-3925-44c0-b9c3-72b4554a8f8a" released by "delete_snapshot" :: held 2.390s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:05:46 devstack cinder-volume[87560]: WARNING cinder.quota [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-70255488 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-70255488, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:05:46 devstack cinder-volume[87560]: WARNING cinder.quota [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-70255488 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-70255488, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:05:46 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.477s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:46 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:05:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Deleted volume successfully. Sep 04 19:05:46 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] Created reservations ['86635782-9073-455e-bd69-cc1da7861a07', 'bc37fc65-05d5-4c17-bfa9-a36edc35f50d', 'cb025af0-0377-4c5d-88e4-b92d251da10f', 'dc7ad961-f710-4bc7-8a01-892dc6a1ba49'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:05:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-276d7da7-9cc8-4125-82de-f612b9c0b707 tempest-AttachVolumeShelveTestJSON-353558496 None] Lock "cinder-989ea966-545a-4843-ad86-76cfbeaa96cb-delete_volume" released by "delete_volume" :: held 1.906s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:05:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6d93d44f-9e51-423d-b004-fbfa32f61da1 tempest-GroupSnapshotsTest-637712219 None] group_snapshot a74a5af1-035b-4683-9b78-a1c7af6317e9: deleted successfully Sep 04 19:05:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "cinder-quobyte-37a40244-3925-44c0-b9c3-72b4554a8f8a" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:05:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-37a40244-3925-44c0-b9c3-72b4554a8f8a" acquired by "delete_volume" :: waited 0.055s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:05:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac9d338-3c1c-418a-adc6-fe155aa58c88]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:05:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:47 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a Sep 04 19:05:47 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:48 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a" returned: 0 in 0.558s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:48 devstack sudo[90280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a Sep 04 19:05:48 devstack sudo[90280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:48 devstack sudo[90280]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-37a40244-3925-44c0-b9c3-72b4554a8f8a" returned: 0 in 0.287s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] Lock "cinder-quobyte-37a40244-3925-44c0-b9c3-72b4554a8f8a" released by "delete_volume" :: held 0.971s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:05:48 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] Created reservations ['d3291407-10f6-4107-ba14-11114e75fb7f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:05:48 devstack cinder-volume[87560]: WARNING cinder.quota [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-70255488 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-70255488, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:05:48 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] Created reservations ['de240885-12e3-405a-bb4f-b54e6e8a7b57', 'b35547be-02fe-4245-8a5b-8a09aa4d6ba0', '6554fef8-5963-47aa-b220-092d2d33be57', 'c04561ee-351f-4741-a638-ab91591f06d3'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:05:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:05:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:05:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:05:48 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:05:48 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:05:49 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Sep 04 19:05:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.463s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:05:49 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:05:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e223ca19-6512-4e22-86ce-2a9ec3bdccb2 tempest-GroupSnapshotsTest-637712219 None] Delete group completed successfully. Sep 04 19:05:57 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=107,cinder:UPDATE=113,cinder:INSERT=26,cinder:DELETE=5 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:05:57 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=109,cinder:INSERT=27,cinder:UPDATE=110,cinder:DELETE=1 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:05:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-f4181f6f-8434-43f4-af5c-4795b790c974 req-ae46fd8c-b9b7-4e36-a99d-4e8038f41f41 tempest-TaggedAttachmentsTest-1575391100 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:05:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-f4181f6f-8434-43f4-af5c-4795b790c974 req-ae46fd8c-b9b7-4e36-a99d-4e8038f41f41 tempest-TaggedAttachmentsTest-1575391100 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:05:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-f4181f6f-8434-43f4-af5c-4795b790c974 req-ae46fd8c-b9b7-4e36-a99d-4e8038f41f41 tempest-TaggedAttachmentsTest-1575391100 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:05:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-f4181f6f-8434-43f4-af5c-4795b790c974 req-ae46fd8c-b9b7-4e36-a99d-4e8038f41f41 tempest-TaggedAttachmentsTest-1575391100 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-8683c3b3-bbe4-484f-886f-b399c5bb8689', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dca5724c-b487-4a88-bd8c-8b227afe3f81', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:05:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-f4181f6f-8434-43f4-af5c-4795b790c974 req-ae46fd8c-b9b7-4e36-a99d-4e8038f41f41 tempest-TaggedAttachmentsTest-1575391100 None] attachment_update completed successfully. Sep 04 19:05:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6f8367d2-7791-41af-9f4f-0625159dc5dc tempest-GroupSnapshotsV319Test-1426791600 None] Group tempest-GroupSnapshotsV319Test-Group-2129330425: creating Sep 04 19:05:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6f8367d2-7791-41af-9f4f-0625159dc5dc tempest-GroupSnapshotsV319Test-1426791600 None] Group tempest-GroupSnapshotsV319Test-Group-2129330425: created successfully Sep 04 19:05:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6f8367d2-7791-41af-9f4f-0625159dc5dc tempest-GroupSnapshotsV319Test-1426791600 None] Create group completed successfully. Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Flow 'volume_create_manager' (9629023e-c45e-4d22-9180-f77224d6364d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1f9ef5-b5e2-4760-b7d1-2c80b35d9aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb1f9ef5-b5e2-4760-b7d1-2c80b35d9aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-704210156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b1d50273-9b35-4986-867e-50ab41e3dde9,host='devstack@QuobyteHD#QuobyteHD',id=010b068e-df91-4ddb-a00e-5525be71a990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30b2cd9eace4270a67ba5a3c44617fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:06:00Z,use_quota=True,user_id='6cb9c86d173141fa950f85be618c6fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78b519f4-168e-493d-945a-f64259e92361),volume_type_id=78b519f4-168e-493d-945a-f64259e92361)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab975af5-c667-4a91-aa0c-39d23a5630e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab975af5-c667-4a91-aa0c-39d23a5630e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1188e0a-ee97-4c50-8797-9ef289d0f817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1188e0a-ee97-4c50-8797-9ef289d0f817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '010b068e-df91-4ddb-a00e-5525be71a990', 'volume_name': 'volume-010b068e-df91-4ddb-a00e-5525be71a990', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbf7580-c1f3-4e84-8fd2-389ab19782a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbf7580-c1f3-4e84-8fd2-389ab19782a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60308b97-c368-4098-99b3-d7b4beeddca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:00 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Volume 010b068e-df91-4ddb-a00e-5525be71a990: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-010b068e-df91-4ddb-a00e-5525be71a990', 'volume_size': 1} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b1d50273-9b35-4986-867e-50ab41e3dde9,created_at=2026-09-04T17:06:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-704210156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b1d50273-9b35-4986-867e-50ab41e3dde9,host='devstack@QuobyteHD#QuobyteHD',id=010b068e-df91-4ddb-a00e-5525be71a990,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e30b2cd9eace4270a67ba5a3c44617fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:06:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:06:00Z,use_quota=True,user_id='6cb9c86d173141fa950f85be618c6fb1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78b519f4-168e-493d-945a-f64259e92361),volume_type_id=78b519f4-168e-493d-945a-f64259e92361)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Creating volume 010b068e-df91-4ddb-a00e-5525be71a990 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:06:00 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:00 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990 1073741824 Sep 04 19:06:00 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:00 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990 1073741824" returned: 0 in 0.536s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:00 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990 Sep 04 19:06:00 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:00 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990" returned: 0 in 0.294s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:06:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60308b97-c368-4098-99b3-d7b4beeddca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-010b068e-df91-4ddb-a00e-5525be71a990', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac29218b-1921-4534-990d-aeae02275b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:01 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Volume volume-010b068e-df91-4ddb-a00e-5525be71a990 (010b068e-df91-4ddb-a00e-5525be71a990): created successfully Sep 04 19:06:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac29218b-1921-4534-990d-aeae02275b65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Flow 'volume_create_manager' (9629023e-c45e-4d22-9180-f77224d6364d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:06:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-76d446ee-ed60-4f66-bfa9-d4988faa8af5 tempest-GroupSnapshotsV319Test-1426791600 None] Created volume successfully. Sep 04 19:06:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-0464599b-4b36-4575-89f6-1e9905302293 req-7e8df045-5291-417c-81f8-29bb5e735af2 tempest-TaggedAttachmentsTest-1575391100 None] Terminate volume connection completed successfully. Sep 04 19:06:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-0464599b-4b36-4575-89f6-1e9905302293 req-7e8df045-5291-417c-81f8-29bb5e735af2 tempest-TaggedAttachmentsTest-1575391100 None] Deleting attachment dca5724c-b487-4a88-bd8c-8b227afe3f81. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:06:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] GroupSnapshot 57fb1f85-83e1-4e43-9352-93d2c831c562: creating. Sep 04 19:06:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] Group snapshot 57fb1f85-83e1-4e43-9352-93d2c831c562: creating. {{(pid=87560) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 04 19:06:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] Creating offline snapshot f8d61d36-ed5e-41ab-bb95-ec76745548d3 of volume 010b068e-df91-4ddb-a00e-5525be71a990 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:06:01 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcca0575-f309-40ef-8c42-e9e62c37d66c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:01 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990 Sep 04 19:06:01 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:02 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990" returned: 0 in 0.572s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:02 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3 1G Sep 04 19:06:02 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:02 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3 1G" returned: 0 in 0.573s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010b068e-df91-4ddb-a00e-5525be71a990 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:02 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010b068e-df91-4ddb-a00e-5525be71a990 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3 Sep 04 19:06:02 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:03 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-010b068e-df91-4ddb-a00e-5525be71a990 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3" returned: 0 in 0.402s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:03 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 19:06:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:03 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3 Sep 04 19:06:03 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:03 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3" returned: 0 in 0.315s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:03 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.info Sep 04 19:06:03 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:03 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.info" returned: 0 in 0.294s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:03 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 19:06:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:03 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.info Sep 04 19:06:03 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:04 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.info" returned: 0 in 0.258s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.512s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:04 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3a419074-9454-48c7-ab3e-8cd74862eaaf tempest-GroupSnapshotsV319Test-1426791600 None] group_snapshot 57fb1f85-83e1-4e43-9352-93d2c831c562: created successfully Sep 04 19:06:05 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] group_snapshot 57fb1f85-83e1-4e43-9352-93d2c831c562: deleting Sep 04 19:06:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] group_snapshot 57fb1f85-83e1-4e43-9352-93d2c831c562: deleting {{(pid=87560) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 04 19:06:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] Acquiring lock "cinder-quobyte-010b068e-df91-4ddb-a00e-5525be71a990" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] Lock "cinder-quobyte-010b068e-df91-4ddb-a00e-5525be71a990" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] Acquiring lock "cinder-quobyte-f8d61d36-ed5e-41ab-bb95-ec76745548d3" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] Lock "cinder-quobyte-f8d61d36-ed5e-41ab-bb95-ec76745548d3" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] Deleting offline snapshot f8d61d36-ed5e-41ab-bb95-ec76745548d3 of volume 010b068e-df91-4ddb-a00e-5525be71a990 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:06:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] snapshot_file for this snap is: volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:06:05 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[88082096-93ba-4979-bdf1-09e580c6c5de]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:05 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3 Sep 04 19:06:05 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:06 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3" returned: 0 in 0.671s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-010b068e-df91-4ddb-a00e-5525be71a990(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:06:06 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb53471f-5a19-46ad-a214-ecc44b44800f]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:06 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990 Sep 04 19:06:06 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:06 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990" returned: 0 in 0.528s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:06 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3 Sep 04 19:06:06 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:07 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3" returned: 0 in 0.482s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:07 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3 Sep 04 19:06:07 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:07 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990.f8d61d36-ed5e-41ab-bb95-ec76745548d3" returned: 0 in 0.411s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] Lock "cinder-quobyte-f8d61d36-ed5e-41ab-bb95-ec76745548d3" released by "_delete_snapshot" :: held 2.292s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] Lock "cinder-quobyte-010b068e-df91-4ddb-a00e-5525be71a990" released by "delete_snapshot" :: held 2.346s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:07 devstack cinder-volume[87560]: WARNING cinder.quota [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-871211298 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-871211298, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:06:07 devstack cinder-volume[87560]: WARNING cinder.quota [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-871211298 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-871211298, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:06:07 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] Created reservations ['5e11ddf6-d8d8-479d-84eb-cb564078a399', 'd7a6b77e-f520-466d-9b94-3a00ed091db2', '573e48a0-1b3f-4192-9f89-a17cda5b1e6a', '880033c6-f318-4bf9-9e56-a7cc3b2769ff'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:06:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0ab94325-5947-4ef9-b217-76eb4d14222b tempest-GroupSnapshotsV319Test-1426791600 None] group_snapshot 57fb1f85-83e1-4e43-9352-93d2c831c562: deleted successfully Sep 04 19:06:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-c9a12e9c-ebc4-4a30-ad15-33d2eb70c007 req-7dc51246-ce5c-4cd0-a8a8-f6b1fce8bcdb tempest-ServerActionsTestOtherA-1479936215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-c9a12e9c-ebc4-4a30-ad15-33d2eb70c007 req-7dc51246-ce5c-4cd0-a8a8-f6b1fce8bcdb tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-c9a12e9c-ebc4-4a30-ad15-33d2eb70c007 req-7dc51246-ce5c-4cd0-a8a8-f6b1fce8bcdb tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-c9a12e9c-ebc4-4a30-ad15-33d2eb70c007 req-7dc51246-ce5c-4cd0-a8a8-f6b1fce8bcdb tempest-ServerActionsTestOtherA-1479936215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '299310b8-3ed7-4e8a-a84e-3a8558b4e17d', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:06:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-c9a12e9c-ebc4-4a30-ad15-33d2eb70c007 req-7dc51246-ce5c-4cd0-a8a8-f6b1fce8bcdb tempest-ServerActionsTestOtherA-1479936215 None] attachment_update completed successfully. Sep 04 19:06:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] Acquiring lock "cinder-quobyte-010b068e-df91-4ddb-a00e-5525be71a990" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] Lock "cinder-quobyte-010b068e-df91-4ddb-a00e-5525be71a990" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4b4bc0-9ced-416d-a1ed-4ebfdfbb198a]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:09 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990 Sep 04 19:06:09 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:09 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990" returned: 0 in 0.574s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:09 devstack sudo[91302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990 Sep 04 19:06:09 devstack sudo[91302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:10 devstack sudo[91302]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-010b068e-df91-4ddb-a00e-5525be71a990" returned: 0 in 0.355s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] Lock "cinder-quobyte-010b068e-df91-4ddb-a00e-5525be71a990" released by "delete_volume" :: held 1.017s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:10 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] Created reservations ['4b082024-f558-4b9b-bef9-16cbbdcaa25a'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:06:10 devstack cinder-volume[87560]: WARNING cinder.quota [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-871211298 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-871211298, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:06:10 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] Created reservations ['a9ed9b97-aea7-4c66-a103-3677170014f7', 'bc04c9b9-9700-44b3-b5f2-f948ba194b25', '63b52053-f6bd-4644-b207-ebe6361bae6f', '1e677b9a-23f0-43a5-8a29-19959e015fa9'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:06:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:06:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:06:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:10 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:06:10 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:10 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.366s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:10 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:06:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b1265f33-237a-4ca8-bc5f-d32ac2875732 tempest-GroupSnapshotsV319Test-1426791600 None] Delete group completed successfully. Sep 04 19:06:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Acquiring lock "cinder-8683c3b3-bbe4-484f-886f-b399c5bb8689-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Lock "cinder-8683c3b3-bbe4-484f-886f-b399c5bb8689-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Acquiring lock "cinder-quobyte-8683c3b3-bbe4-484f-886f-b399c5bb8689" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Lock "cinder-quobyte-8683c3b3-bbe4-484f-886f-b399c5bb8689" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:11 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb30071-fc1d-43e6-b399-a5d237b03c2a]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8683c3b3-bbe4-484f-886f-b399c5bb8689 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:11 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8683c3b3-bbe4-484f-886f-b399c5bb8689 Sep 04 19:06:11 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:12 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8683c3b3-bbe4-484f-886f-b399c5bb8689" returned: 0 in 0.486s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8683c3b3-bbe4-484f-886f-b399c5bb8689 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:12 devstack sudo[91315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8683c3b3-bbe4-484f-886f-b399c5bb8689 Sep 04 19:06:12 devstack sudo[91315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:12 devstack sudo[91315]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8683c3b3-bbe4-484f-886f-b399c5bb8689" returned: 0 in 0.386s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Lock "cinder-quobyte-8683c3b3-bbe4-484f-886f-b399c5bb8689" released by "delete_volume" :: held 0.956s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:12 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Created reservations ['62f56099-dbd5-48f1-82a6-58171324a3cf', '299ed278-0768-4f4d-99ef-69581a992310', '30eea9c3-b6be-4834-aa10-94f4143ff1a5', '33948811-92e6-4655-80b5-afe4efcf6fd3'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:06:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:06:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:06:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:12 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:06:12 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:13 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.374s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:13 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:06:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Deleted volume successfully. Sep 04 19:06:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef063847-0a8e-4d86-86e4-ed40b8e075b5 tempest-TaggedAttachmentsTest-1575391100 None] Lock "cinder-8683c3b3-bbe4-484f-886f-b399c5bb8689-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-f4ab1f79-691a-4e31-b180-78a3ddc944bc req-c0a65795-c81c-4ad1-8095-3917dc8c8346 tempest-ServerActionsTestOtherA-1479936215 None] Terminate volume connection completed successfully. Sep 04 19:06:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-f4ab1f79-691a-4e31-b180-78a3ddc944bc req-c0a65795-c81c-4ad1-8095-3917dc8c8346 tempest-ServerActionsTestOtherA-1479936215 None] Deleting attachment 299310b8-3ed7-4e8a-a84e-3a8558b4e17d. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:06:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-f4ab1f79-691a-4e31-b180-78a3ddc944bc req-2c6a18da-44e1-466a-b008-f9fb888aa547 tempest-ServerActionsTestOtherA-1479936215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-f4ab1f79-691a-4e31-b180-78a3ddc944bc req-2c6a18da-44e1-466a-b008-f9fb888aa547 tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-f4ab1f79-691a-4e31-b180-78a3ddc944bc req-2c6a18da-44e1-466a-b008-f9fb888aa547 tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-f4ab1f79-691a-4e31-b180-78a3ddc944bc req-2c6a18da-44e1-466a-b008-f9fb888aa547 tempest-ServerActionsTestOtherA-1479936215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd65c6a7f-0de0-40af-98e3-9e85a290edcd', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:06:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-f4ab1f79-691a-4e31-b180-78a3ddc944bc req-2c6a18da-44e1-466a-b008-f9fb888aa547 tempest-ServerActionsTestOtherA-1479936215 None] attachment_update completed successfully. Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Flow 'volume_create_manager' (ddb28675-c372-4373-8e68-05be9e295642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2275a74c-c807-4a54-8597-3a444d55c282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2275a74c-c807-4a54-8597-3a444d55c282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1407448435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d021de-69b1-4ba2-9561-5e02dfdb1b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1c12c47d004864975a9392cd3d5821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:06:20Z,use_quota=True,user_id='6e3d40cff9474dd09d580664a9f37f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f23fb26-f6c2-4e28-be46-fcbdfddc3313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f23fb26-f6c2-4e28-be46-fcbdfddc3313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fd2fac-0d55-4e41-aeb9-484a45780025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7fd2fac-0d55-4e41-aeb9-484a45780025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30d021de-69b1-4ba2-9561-5e02dfdb1b59', 'volume_name': 'volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b8a7d0-b7e7-4e23-a883-377f8dcc3038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99b8a7d0-b7e7-4e23-a883-377f8dcc3038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be78fa94-5762-4ce8-b930-1dca6710f0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:20 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Volume 30d021de-69b1-4ba2-9561-5e02dfdb1b59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59', 'volume_size': 1} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:06:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1407448435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30d021de-69b1-4ba2-9561-5e02dfdb1b59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a1c12c47d004864975a9392cd3d5821',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:06:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:06:20Z,use_quota=True,user_id='6e3d40cff9474dd09d580664a9f37f0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Creating volume 30d021de-69b1-4ba2-9561-5e02dfdb1b59 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:06:20 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:06:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:20 devstack sudo[91828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 1073741824 Sep 04 19:06:20 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:21 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 1073741824" returned: 0 in 0.880s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:21 devstack sudo[91871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 Sep 04 19:06:21 devstack sudo[91871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:21 devstack sudo[91871]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59" returned: 0 in 0.386s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:06:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be78fa94-5762-4ce8-b930-1dca6710f0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00557bbd-6430-449d-8f5f-fff2ddd9712d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:21 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Volume volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 (30d021de-69b1-4ba2-9561-5e02dfdb1b59): created successfully Sep 04 19:06:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00557bbd-6430-449d-8f5f-fff2ddd9712d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Flow 'volume_create_manager' (ddb28675-c372-4373-8e68-05be9e295642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:06:21 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4addf67a-dcb7-4274-97e4-3b93d9ce04ea tempest-SnapshotsActionsTest-1786728269 None] Created volume successfully. Sep 04 19:06:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] Creating offline snapshot e067448a-05f0-40cf-ab68-f1e70ab8071c of volume 30d021de-69b1-4ba2-9561-5e02dfdb1b59 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:06:23 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd643a6a-758c-418f-a3af-bd265a97377d]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:23 devstack sudo[91891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 Sep 04 19:06:23 devstack sudo[91891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:23 devstack sudo[91891]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59" returned: 0 in 0.604s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:23 devstack sudo[91899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c 1G Sep 04 19:06:23 devstack sudo[91899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:24 devstack sudo[91899]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c 1G" returned: 0 in 0.431s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:24 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c Sep 04 19:06:24 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:24 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c" returned: 0 in 0.423s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:24 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c is being set with open permissions: ugo+rw Sep 04 19:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:24 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c Sep 04 19:06:24 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:24 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c" returned: 0 in 0.409s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:25 devstack sudo[91915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.info Sep 04 19:06:25 devstack sudo[91915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:25 devstack sudo[91915]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.info" returned: 0 in 0.302s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:25 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.info is being set with open permissions: ugo+rw Sep 04 19:06:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:25 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.info Sep 04 19:06:25 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:25 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.info" returned: 0 in 0.311s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.598s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7e80b30e-fbae-46a2-b7b9-ece32b6f3dcd tempest-SnapshotsActionsTest-1786728269 None] Create snapshot completed successfully Sep 04 19:06:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-810cc4b7-291b-458a-98c4-02e71824d43f tempest-SnapshotsActionsTest-1786728269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-810cc4b7-291b-458a-98c4-02e71824d43f tempest-SnapshotsActionsTest-1786728269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-810cc4b7-291b-458a-98c4-02e71824d43f tempest-SnapshotsActionsTest-1786728269 None] Creating offline snapshot 2d712784-e160-4fad-8826-2855c612e230 of volume 30d021de-69b1-4ba2-9561-5e02dfdb1b59 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:06:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f4f8db-f102-4b9e-8d76-ccfb4a33dd79]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810cc4b7-291b-458a-98c4-02e71824d43f tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:28 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c Sep 04 19:06:28 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:28 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810cc4b7-291b-458a-98c4-02e71824d43f tempest-SnapshotsActionsTest-1786728269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c" returned: 0 in 0.965s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-810cc4b7-291b-458a-98c4-02e71824d43f tempest-SnapshotsActionsTest-1786728269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:06:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810cc4b7-291b-458a-98c4-02e71824d43f tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:28 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230 1G Sep 04 19:06:28 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:29 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810cc4b7-291b-458a-98c4-02e71824d43f tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230 1G" returned: 0 in 0.636s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810cc4b7-291b-458a-98c4-02e71824d43f tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:29 devstack sudo[92002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230 Sep 04 19:06:29 devstack sudo[92002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:29 devstack sudo[92002]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810cc4b7-291b-458a-98c4-02e71824d43f tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230" returned: 0 in 0.431s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:29 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-810cc4b7-291b-458a-98c4-02e71824d43f tempest-SnapshotsActionsTest-1786728269 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230 is being set with open permissions: ugo+rw Sep 04 19:06:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810cc4b7-291b-458a-98c4-02e71824d43f tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:29 devstack sudo[92009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230 Sep 04 19:06:29 devstack sudo[92009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:30 devstack sudo[92009]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810cc4b7-291b-458a-98c4-02e71824d43f tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230" returned: 0 in 0.614s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-810cc4b7-291b-458a-98c4-02e71824d43f tempest-SnapshotsActionsTest-1786728269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.930s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-810cc4b7-291b-458a-98c4-02e71824d43f tempest-SnapshotsActionsTest-1786728269 None] Create snapshot completed successfully Sep 04 19:06:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Acquiring lock "cinder-2d712784-e160-4fad-8826-2855c612e230-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-2d712784-e160-4fad-8826-2855c612e230-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Acquiring lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Acquiring lock "cinder-quobyte-2d712784-e160-4fad-8826-2855c612e230" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-quobyte-2d712784-e160-4fad-8826-2855c612e230" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Deleting offline snapshot 2d712784-e160-4fad-8826-2855c612e230 of volume 30d021de-69b1-4ba2-9561-5e02dfdb1b59 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:06:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] snapshot_file for this snap is: volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:06:31 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5802f9f5-92eb-4e63-be5d-30ca516e1a47]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:31 devstack sudo[92013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230 Sep 04 19:06:31 devstack sudo[92013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:32 devstack sudo[92013]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230" returned: 0 in 0.907s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:06:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d09c98-3752-4da0-b5f4-c5d366eaf1fe]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:32 devstack sudo[92037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c Sep 04 19:06:32 devstack sudo[92037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:32 devstack sudo[92037]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c" returned: 0 in 0.599s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:06:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:33 devstack sudo[92047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230 Sep 04 19:06:33 devstack sudo[92047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:33 devstack sudo[92047]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230" returned: 0 in 0.559s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:33 devstack sudo[92053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230 Sep 04 19:06:33 devstack sudo[92053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:33 devstack sudo[92053]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.2d712784-e160-4fad-8826-2855c612e230" returned: 0 in 0.270s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-quobyte-2d712784-e160-4fad-8826-2855c612e230" released by "_delete_snapshot" :: held 2.537s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" released by "delete_snapshot" :: held 2.576s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:33 devstack cinder-volume[87560]: WARNING cinder.quota [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:06:33 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Created reservations ['38ba01c7-1bb9-4524-9c29-05c6c78de9de', '029faf16-046c-4764-bbc6-7c56e729ba6c', 'f74b37b1-da5f-4423-9a9e-ae34cac631d1', '66f68860-b358-4351-ac1f-4448883748c3'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:06:33 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Delete snapshot completed successfully. Sep 04 19:06:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-99de5a61-f84f-42e8-a877-c538fc5c1a22 tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-2d712784-e160-4fad-8826-2855c612e230-delete_snapshot" released by "delete_snapshot" :: held 2.749s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-52b404a0-1233-4a07-828f-3b77ec7317ef tempest-SnapshotsActionsTest-1786728269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-52b404a0-1233-4a07-828f-3b77ec7317ef tempest-SnapshotsActionsTest-1786728269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-52b404a0-1233-4a07-828f-3b77ec7317ef tempest-SnapshotsActionsTest-1786728269 None] Creating offline snapshot e7f2abef-1499-407b-9de8-e2e4fef0f621 of volume 30d021de-69b1-4ba2-9561-5e02dfdb1b59 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:06:34 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[49102177-3544-4e0d-8d78-542dbedef973]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-52b404a0-1233-4a07-828f-3b77ec7317ef tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:35 devstack sudo[92056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c Sep 04 19:06:35 devstack sudo[92056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:35 devstack sudo[92056]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-52b404a0-1233-4a07-828f-3b77ec7317ef tempest-SnapshotsActionsTest-1786728269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c" returned: 0 in 0.432s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-52b404a0-1233-4a07-828f-3b77ec7317ef tempest-SnapshotsActionsTest-1786728269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:06:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-52b404a0-1233-4a07-828f-3b77ec7317ef tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:35 devstack sudo[92061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621 1G Sep 04 19:06:35 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:35 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-52b404a0-1233-4a07-828f-3b77ec7317ef tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621 1G" returned: 0 in 0.437s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-52b404a0-1233-4a07-828f-3b77ec7317ef tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:35 devstack sudo[92066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621 Sep 04 19:06:35 devstack sudo[92066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:36 devstack sudo[92066]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-52b404a0-1233-4a07-828f-3b77ec7317ef tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621" returned: 0 in 0.298s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:36 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-52b404a0-1233-4a07-828f-3b77ec7317ef tempest-SnapshotsActionsTest-1786728269 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621 is being set with open permissions: ugo+rw Sep 04 19:06:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-52b404a0-1233-4a07-828f-3b77ec7317ef tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:36 devstack sudo[92071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621 Sep 04 19:06:36 devstack sudo[92071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:36 devstack sudo[92071]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-52b404a0-1233-4a07-828f-3b77ec7317ef tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621" returned: 0 in 0.292s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-52b404a0-1233-4a07-828f-3b77ec7317ef tempest-SnapshotsActionsTest-1786728269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.569s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-52b404a0-1233-4a07-828f-3b77ec7317ef tempest-SnapshotsActionsTest-1786728269 None] Create snapshot completed successfully Sep 04 19:06:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Acquiring lock "cinder-e7f2abef-1499-407b-9de8-e2e4fef0f621-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-e7f2abef-1499-407b-9de8-e2e4fef0f621-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Acquiring lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Acquiring lock "cinder-quobyte-e7f2abef-1499-407b-9de8-e2e4fef0f621" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-quobyte-e7f2abef-1499-407b-9de8-e2e4fef0f621" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Deleting offline snapshot e7f2abef-1499-407b-9de8-e2e4fef0f621 of volume 30d021de-69b1-4ba2-9561-5e02dfdb1b59 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] snapshot_file for this snap is: volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:06:37 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad9a05e-c132-48ea-96e5-76f1ba8cfaf7]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:37 devstack sudo[92099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621 Sep 04 19:06:37 devstack sudo[92099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:37 devstack sudo[92099]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621" returned: 0 in 0.511s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:06:37 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[287b51dc-a4d6-4bde-aaf6-6f021b6493e9]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:37 devstack sudo[92106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c Sep 04 19:06:37 devstack sudo[92106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:38 devstack sudo[92106]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c" returned: 0 in 0.386s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:06:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:38 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621 Sep 04 19:06:38 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:38 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621" returned: 0 in 0.412s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:38 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621 Sep 04 19:06:38 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:39 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e7f2abef-1499-407b-9de8-e2e4fef0f621" returned: 0 in 0.497s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-quobyte-e7f2abef-1499-407b-9de8-e2e4fef0f621" released by "_delete_snapshot" :: held 1.910s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" released by "delete_snapshot" :: held 1.943s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:39 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Created reservations ['1cb8a066-3267-49eb-8055-f93e09cebba9', '9165209c-56ca-4265-9a99-9334f5dc3ba2', 'aeddfee7-6079-413e-a44c-0147483d4d1c', 'a9e0f088-84f1-4d5b-8000-fd9e0bae8f85'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:06:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Delete snapshot completed successfully. Sep 04 19:06:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b7a47636-ec5f-4851-9004-a53a211a7dcc tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-e7f2abef-1499-407b-9de8-e2e4fef0f621-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-04255653-b92a-4d3a-a799-7a0938c39efa tempest-SnapshotsActionsTest-1786728269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-04255653-b92a-4d3a-a799-7a0938c39efa tempest-SnapshotsActionsTest-1786728269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-04255653-b92a-4d3a-a799-7a0938c39efa tempest-SnapshotsActionsTest-1786728269 None] Creating offline snapshot 113a26dc-25b1-48e4-aaaa-10d86b3d5c45 of volume 30d021de-69b1-4ba2-9561-5e02dfdb1b59 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:06:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[be38ccba-681f-43b3-a468-e1f25048a202]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04255653-b92a-4d3a-a799-7a0938c39efa tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:41 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c Sep 04 19:06:41 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:41 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04255653-b92a-4d3a-a799-7a0938c39efa tempest-SnapshotsActionsTest-1786728269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c" returned: 0 in 0.549s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-04255653-b92a-4d3a-a799-7a0938c39efa tempest-SnapshotsActionsTest-1786728269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:06:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04255653-b92a-4d3a-a799-7a0938c39efa tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:41 devstack sudo[92131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45 1G Sep 04 19:06:41 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:42 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04255653-b92a-4d3a-a799-7a0938c39efa tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45 1G" returned: 0 in 0.917s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04255653-b92a-4d3a-a799-7a0938c39efa tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:42 devstack sudo[92161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45 Sep 04 19:06:42 devstack sudo[92161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:42 devstack sudo[92161]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04255653-b92a-4d3a-a799-7a0938c39efa tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45" returned: 0 in 0.440s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:42 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-04255653-b92a-4d3a-a799-7a0938c39efa tempest-SnapshotsActionsTest-1786728269 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45 is being set with open permissions: ugo+rw Sep 04 19:06:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04255653-b92a-4d3a-a799-7a0938c39efa tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:42 devstack sudo[92172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45 Sep 04 19:06:42 devstack sudo[92172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:43 devstack sudo[92172]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04255653-b92a-4d3a-a799-7a0938c39efa tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45" returned: 0 in 0.298s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-04255653-b92a-4d3a-a799-7a0938c39efa tempest-SnapshotsActionsTest-1786728269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.353s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-04255653-b92a-4d3a-a799-7a0938c39efa tempest-SnapshotsActionsTest-1786728269 None] Create snapshot completed successfully Sep 04 19:06:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-8ddee078-e26f-4c97-9971-c765f40e8e24 req-e5b13ff5-6309-4c16-9f0c-d6f773841a5c tempest-ServerActionsTestOtherA-1479936215 None] Terminate volume connection completed successfully. Sep 04 19:06:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-8ddee078-e26f-4c97-9971-c765f40e8e24 req-e5b13ff5-6309-4c16-9f0c-d6f773841a5c tempest-ServerActionsTestOtherA-1479936215 None] Deleting attachment d65c6a7f-0de0-40af-98e3-9e85a290edcd. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:06:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Acquiring lock "cinder-113a26dc-25b1-48e4-aaaa-10d86b3d5c45-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-113a26dc-25b1-48e4-aaaa-10d86b3d5c45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Acquiring lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Acquiring lock "cinder-quobyte-113a26dc-25b1-48e4-aaaa-10d86b3d5c45" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-quobyte-113a26dc-25b1-48e4-aaaa-10d86b3d5c45" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Deleting offline snapshot 113a26dc-25b1-48e4-aaaa-10d86b3d5c45 of volume 30d021de-69b1-4ba2-9561-5e02dfdb1b59 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] snapshot_file for this snap is: volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:06:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[11316d07-a31c-4a49-b7ab-218375a96afa]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:44 devstack sudo[92196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45 Sep 04 19:06:44 devstack sudo[92196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:44 devstack sudo[92196]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45" returned: 0 in 0.569s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:06:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5986a79e-91d4-4f9a-854d-a4e322b65509]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:45 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c Sep 04 19:06:45 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:45 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:06:45 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:45 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c" returned: 0 in 0.445s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:45 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45 Sep 04 19:06:45 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:45 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.381s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 8 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:06:45 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45" returned: 0 in 0.490s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:45 devstack sudo[92237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45 Sep 04 19:06:45 devstack sudo[92237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:46 devstack sudo[92237]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.113a26dc-25b1-48e4-aaaa-10d86b3d5c45" returned: 0 in 0.316s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-quobyte-113a26dc-25b1-48e4-aaaa-10d86b3d5c45" released by "_delete_snapshot" :: held 1.971s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" released by "delete_snapshot" :: held 2.012s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:46 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Created reservations ['98d177b0-c92c-4e46-b6e0-8cb8269f095b', '5867ba7c-548b-4807-80ad-8877f872c478', 'eda21ba6-959e-46a0-a1e0-002bbdc00078', 'c7280a22-ffe6-4f07-87da-21a50d77b134'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:06:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Delete snapshot completed successfully. Sep 04 19:06:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-92165533-74f2-4da4-aaf8-3d38e166ff9c tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-113a26dc-25b1-48e4-aaaa-10d86b3d5c45-delete_snapshot" released by "delete_snapshot" :: held 2.244s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d35aa5ed-aaef-4ee8-8300-48ad3a644cf6 tempest-SnapshotsActionsTest-1786728269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d35aa5ed-aaef-4ee8-8300-48ad3a644cf6 tempest-SnapshotsActionsTest-1786728269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d35aa5ed-aaef-4ee8-8300-48ad3a644cf6 tempest-SnapshotsActionsTest-1786728269 None] Creating offline snapshot 1cfb84bf-19af-4329-9a58-399d064af71e of volume 30d021de-69b1-4ba2-9561-5e02dfdb1b59 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:06:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd34bb57-1208-4930-ac96-e5437d0c7bb6]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d35aa5ed-aaef-4ee8-8300-48ad3a644cf6 tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:47 devstack sudo[92244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c Sep 04 19:06:47 devstack sudo[92244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:48 devstack sudo[92244]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d35aa5ed-aaef-4ee8-8300-48ad3a644cf6 tempest-SnapshotsActionsTest-1786728269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c" returned: 0 in 0.358s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d35aa5ed-aaef-4ee8-8300-48ad3a644cf6 tempest-SnapshotsActionsTest-1786728269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:06:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d35aa5ed-aaef-4ee8-8300-48ad3a644cf6 tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:48 devstack sudo[92249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e 1G Sep 04 19:06:48 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:48 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d35aa5ed-aaef-4ee8-8300-48ad3a644cf6 tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e 1G" returned: 0 in 0.541s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d35aa5ed-aaef-4ee8-8300-48ad3a644cf6 tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:48 devstack sudo[92261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e Sep 04 19:06:48 devstack sudo[92261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:49 devstack sudo[92261]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d35aa5ed-aaef-4ee8-8300-48ad3a644cf6 tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e" returned: 0 in 0.356s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:49 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-d35aa5ed-aaef-4ee8-8300-48ad3a644cf6 tempest-SnapshotsActionsTest-1786728269 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e is being set with open permissions: ugo+rw Sep 04 19:06:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d35aa5ed-aaef-4ee8-8300-48ad3a644cf6 tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:49 devstack sudo[92266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e Sep 04 19:06:49 devstack sudo[92266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:49 devstack sudo[92266]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d35aa5ed-aaef-4ee8-8300-48ad3a644cf6 tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e" returned: 0 in 0.272s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d35aa5ed-aaef-4ee8-8300-48ad3a644cf6 tempest-SnapshotsActionsTest-1786728269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.658s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d35aa5ed-aaef-4ee8-8300-48ad3a644cf6 tempest-SnapshotsActionsTest-1786728269 None] Create snapshot completed successfully Sep 04 19:06:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Acquiring lock "cinder-1cfb84bf-19af-4329-9a58-399d064af71e-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-1cfb84bf-19af-4329-9a58-399d064af71e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Acquiring lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Acquiring lock "cinder-quobyte-1cfb84bf-19af-4329-9a58-399d064af71e" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-quobyte-1cfb84bf-19af-4329-9a58-399d064af71e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Deleting offline snapshot 1cfb84bf-19af-4329-9a58-399d064af71e of volume 30d021de-69b1-4ba2-9561-5e02dfdb1b59 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:06:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] snapshot_file for this snap is: volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:06:50 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50ca483-4ded-43e2-992a-4f9a93c7828e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:50 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e Sep 04 19:06:50 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:50 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e" returned: 0 in 0.564s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:06:50 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b060e03f-7293-4731-bef0-c357c83949a2]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:50 devstack sudo[92280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c Sep 04 19:06:50 devstack sudo[92280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:51 devstack sudo[92280]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c" returned: 0 in 0.568s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:06:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:51 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e Sep 04 19:06:51 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:51 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:06:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Flow 'volume_create_manager' (e4f2c57b-f247-402d-9f7f-b9ba96a9ce22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:06:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ffea42-f799-4589-bca5-3668cdbda2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60ffea42-f799-4589-bca5-3668cdbda2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1517788177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b02ff7-8af3-45ff-9f9e-34821b34ef90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27db1e1cc30f4385a9d94c2acca66893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:06:51Z,use_quota=True,user_id='191fd840707244f8aa95a2379e85d05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9381d19f-7ca3-4d85-b3ea-2cfd61765f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9381d19f-7ca3-4d85-b3ea-2cfd61765f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7bbe237-3aa4-4fac-b3b5-3251713adb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:51 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 19:06:51 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e" returned: 0 in 0.565s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:51 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e Sep 04 19:06:51 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7bbe237-3aa4-4fac-b3b5-3251713adb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '29b02ff7-8af3-45ff-9f9e-34821b34ef90', 'volume_name': 'volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90', 'volume_size': 1, 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd0ece6d722f24154ab955bf866d06cbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'created_at': datetime.datetime(2026, 9, 4, 16, 58, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 58, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e637b08c-391d-4edc-8402-9ba212deb71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e853c6-3483-4131-af73-858af99ed070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0e853c6-3483-4131-af73-858af99ed070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ea1802-592d-476a-97c0-83c343ecdf73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:52 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Volume 29b02ff7-8af3-45ff-9f9e-34821b34ef90: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90', 'volume_size': 1, 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd0ece6d722f24154ab955bf866d06cbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'created_at': datetime.datetime(2026, 9, 4, 16, 58, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 58, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e637b08c-391d-4edc-8402-9ba212deb71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 19:06:52 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Trying to clone 29b02ff7-8af3-45ff-9f9e-34821b34ef90 from image e637b08c-391d-4edc-8402-9ba212deb71d at location (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 19:06:52 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.1cfb84bf-19af-4329-9a58-399d064af71e" returned: 0 in 0.431s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-quobyte-1cfb84bf-19af-4329-9a58-399d064af71e" released by "_delete_snapshot" :: held 2.433s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" released by "delete_snapshot" :: held 2.499s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:52 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Created reservations ['c949b0e8-f478-4270-9f99-bba79557f3b3', 'aaac4f37-6892-40d4-a273-09b1bef4b4c9', '49872cbe-7182-4ff7-a098-8c4fa992896e', '35d7c5c5-c187-42c0-8d0b-778e158ce76b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:06:52 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_y_9w1pk5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 19:06:52 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Image download 20.69 MB at 20.69 MB/s Sep 04 19:06:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Delete snapshot completed successfully. Sep 04 19:06:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d4fd4408-8b79-4b2d-a5fb-5275bed6b7fb tempest-SnapshotsActionsTest-1173325326 None] Lock "cinder-1cfb84bf-19af-4329-9a58-399d064af71e-delete_snapshot" released by "delete_snapshot" :: held 2.856s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:52 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27e7b31-a88c-43b2-b1fb-085333b295a2]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_y_9w1pk5devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:53 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_y_9w1pk5devstack@QuobyteHD Sep 04 19:06:53 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:53 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_y_9w1pk5devstack@QuobyteHD" returned: 0 in 0.459s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Temporary image e637b08c-391d-4edc-8402-9ba212deb71d is fetched for user 191fd840707244f8aa95a2379e85d05a. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Flow 'volume_create_manager' (204e300c-ae98-448c-be60-746cfdf1e63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8b8922-3a81-49b9-afdd-67e93e5f7937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d8b8922-3a81-49b9-afdd-67e93e5f7937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-39561563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec051c3-bfab-4a1d-90fe-95caa9572b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a13e1b4d78647559438efc43d7815c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:06:53Z,use_quota=True,user_id='0374ed63eb9c4ac1bfecef338246062f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d28504b-038b-4798-bda1-be4f10664957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d28504b-038b-4798-bda1-be4f10664957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a69fd6-714a-4f94-9a82-83bebc6e1df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98a69fd6-714a-4f94-9a82-83bebc6e1df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec051c3-bfab-4a1d-90fe-95caa9572b49', 'volume_name': 'volume-bec051c3-bfab-4a1d-90fe-95caa9572b49', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9929f0e9-be76-429c-b0e1-86450ae8ff5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9929f0e9-be76-429c-b0e1-86450ae8ff5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f58ea42-1365-4913-a425-69b850d29a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:53 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Volume bec051c3-bfab-4a1d-90fe-95caa9572b49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec051c3-bfab-4a1d-90fe-95caa9572b49', 'volume_size': 1} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-39561563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec051c3-bfab-4a1d-90fe-95caa9572b49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a13e1b4d78647559438efc43d7815c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:06:53Z,use_quota=True,user_id='0374ed63eb9c4ac1bfecef338246062f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Creating volume bec051c3-bfab-4a1d-90fe-95caa9572b49 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:06:53 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bec051c3-bfab-4a1d-90fe-95caa9572b49 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:53 devstack sudo[92337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bec051c3-bfab-4a1d-90fe-95caa9572b49 1073741824 Sep 04 19:06:53 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[20754610-504c-4582-bfa3-ae9182d93960]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_y_9w1pk5devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Acquiring lock "cinder-e067448a-05f0-40cf-ab68-f1e70ab8071c-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Lock "cinder-e067448a-05f0-40cf-ab68-f1e70ab8071c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Acquiring lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Acquiring lock "cinder-quobyte-e067448a-05f0-40cf-ab68-f1e70ab8071c" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:53 devstack sudo[92339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_y_9w1pk5devstack@QuobyteHD Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Lock "cinder-quobyte-e067448a-05f0-40cf-ab68-f1e70ab8071c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:53 devstack sudo[92339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Deleting offline snapshot e067448a-05f0-40cf-ab68-f1e70ab8071c of volume 30d021de-69b1-4ba2-9561-5e02dfdb1b59 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] snapshot_file for this snap is: volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[be31e877-ca2b-4066-9cc3-f205a9fdb89d]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:53 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c Sep 04 19:06:53 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:54 devstack sudo[92339]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_y_9w1pk5devstack@QuobyteHD" returned: 0 in 0.428s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:54 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bec051c3-bfab-4a1d-90fe-95caa9572b49 1073741824" returned: 0 in 0.610s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bec051c3-bfab-4a1d-90fe-95caa9572b49 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:54 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bec051c3-bfab-4a1d-90fe-95caa9572b49 Sep 04 19:06:54 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:54 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c" returned: 0 in 0.456s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5ee751-7cf7-4dae-9ead-43d8850f44c3]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:54 devstack sudo[92358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 Sep 04 19:06:54 devstack sudo[92358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:54 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bec051c3-bfab-4a1d-90fe-95caa9572b49" returned: 0 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.573s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:06:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1517788177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29b02ff7-8af3-45ff-9f9e-34821b34ef90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27db1e1cc30f4385a9d94c2acca66893',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:06:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:06:51Z,use_quota=True,user_id='191fd840707244f8aa95a2379e85d05a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Creating volume 29b02ff7-8af3-45ff-9f9e-34821b34ef90 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:06:54 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f58ea42-1365-4913-a425-69b850d29a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec051c3-bfab-4a1d-90fe-95caa9572b49', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:54 devstack sudo[92361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90 1073741824 Sep 04 19:06:54 devstack sudo[92361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d2b6ac-046f-4da6-acb7-f312dff377c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:06:54 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Volume volume-bec051c3-bfab-4a1d-90fe-95caa9572b49 (bec051c3-bfab-4a1d-90fe-95caa9572b49): created successfully Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d2b6ac-046f-4da6-acb7-f312dff377c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Flow 'volume_create_manager' (204e300c-ae98-448c-be60-746cfdf1e63c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:06:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3ae01a90-3c36-429a-a467-0b8952be6a0b tempest-AttachVolumeNegativeTest-23207716 None] Created volume successfully. Sep 04 19:06:54 devstack sudo[92358]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59" returned: 0 in 0.573s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:55 devstack sudo[92380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c Sep 04 19:06:55 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:55 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c" returned: 0 in 0.618s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:55 devstack sudo[92361]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90 1073741824" returned: 0 in 0.956s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:55 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c Sep 04 19:06:55 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:55 devstack sudo[92437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90 Sep 04 19:06:55 devstack sudo[92437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:56 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59.e067448a-05f0-40cf-ab68-f1e70ab8071c" returned: 0 in 0.545s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Lock "cinder-quobyte-e067448a-05f0-40cf-ab68-f1e70ab8071c" released by "_delete_snapshot" :: held 2.395s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" released by "delete_snapshot" :: held 2.426s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:56 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Created reservations ['205fc6b4-4f67-4571-8325-77d961536c2d', '44844cf9-2bec-4e70-8af1-12d410e4e539', 'a19dd1f1-95ad-43f3-99cf-467137707ce5', '523c1b0f-8178-4686-ad4b-3bb4d02071a9'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:06:56 devstack sudo[92437]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90" returned: 0 in 0.708s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] <== create_volume: return (1774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:06:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:56 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Attempting download of e637b08c-391d-4edc-8402-9ba212deb71d ((None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}])) to volume 29b02ff7-8af3-45ff-9f9e-34821b34ef90. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 19:06:56 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Delete snapshot completed successfully. Sep 04 19:06:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7e3284c-13ff-4fb9-a60f-61ee2dd320a6 tempest-SnapshotsActionsTest-1786728269 None] Lock "cinder-e067448a-05f0-40cf-ab68-f1e70ab8071c-delete_snapshot" released by "delete_snapshot" :: held 2.860s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:56 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e61aad0-e69d-49de-84ab-383dcbcba906]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_z523w32r {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:56 devstack sudo[92454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_z523w32r Sep 04 19:06:56 devstack sudo[92454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-6f7fb13e-5269-499d-93cb-002970451fe2 req-c8239502-b6b1-4bdc-8417-f165cc30d07d tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-6f7fb13e-5269-499d-93cb-002970451fe2 req-c8239502-b6b1-4bdc-8417-f165cc30d07d tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-6f7fb13e-5269-499d-93cb-002970451fe2 req-c8239502-b6b1-4bdc-8417-f165cc30d07d tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-6f7fb13e-5269-499d-93cb-002970451fe2 req-c8239502-b6b1-4bdc-8417-f165cc30d07d tempest-AttachVolumeNegativeTest-23207716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-bec051c3-bfab-4a1d-90fe-95caa9572b49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f67ff6fb-61aa-496e-ba5c-96468f702d22', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:06:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Acquiring lock "cinder-30d021de-69b1-4ba2-9561-5e02dfdb1b59-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:57 devstack sudo[92454]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_z523w32r" returned: 0 in 0.633s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_z523w32r {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Lock "cinder-30d021de-69b1-4ba2-9561-5e02dfdb1b59-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-6f7fb13e-5269-499d-93cb-002970451fe2 req-c8239502-b6b1-4bdc-8417-f165cc30d07d tempest-AttachVolumeNegativeTest-23207716 None] attachment_update completed successfully. Sep 04 19:06:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Acquiring lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:06:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:06:57 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[581039d9-f604-4918-bcb5-0a28e45236a6]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:57 devstack sudo[92469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_z523w32r Sep 04 19:06:57 devstack sudo[92469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:57 devstack sudo[92471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 Sep 04 19:06:57 devstack sudo[92471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:58 devstack sudo[92469]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_z523w32r" returned: 1 in 0.776s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_z523w32r' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:06:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ec2953-bce7-4471-8a8d-84d95d1c8aa8]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_y_9w1pk5devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:58 devstack sudo[92471]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59" returned: 0 in 0.769s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:58 devstack sudo[92858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_y_9w1pk5devstack@QuobyteHD Sep 04 19:06:58 devstack sudo[92858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:58 devstack sudo[92863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59 Sep 04 19:06:58 devstack sudo[92863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:58 devstack sudo[92858]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_y_9w1pk5devstack@QuobyteHD" returned: 0 in 0.536s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:58 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] e637b08c-391d-4edc-8402-9ba212deb71d was qcow2, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 19:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_y_9w1pk5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:58 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_y_9w1pk5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90 Sep 04 19:06:58 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:58 devstack sudo[92863]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-30d021de-69b1-4ba2-9561-5e02dfdb1b59" returned: 0 in 0.502s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Lock "cinder-quobyte-30d021de-69b1-4ba2-9561-5e02dfdb1b59" released by "delete_volume" :: held 1.380s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:06:58 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=85,cinder:SELECT=107,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:06:58 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=101,cinder:UPDATE=74,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:06:58 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Created reservations ['f2a7a2f3-f49c-4230-a8c5-c5d582f94af9', '6f9be088-8ff2-402f-9225-b6a89b03c3dc', '4ebaf05d-a917-4122-bf70-83940b7d6871', 'ca7c76dc-b225-4f99-a897-bcbde0390bba'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:06:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:06:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:06:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:06:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:06:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:06:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:06:59 devstack sudo[92876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:06:59 devstack sudo[92876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:06:59 devstack sudo[92876]: pam_unix(sudo:session): session closed for user root Sep 04 19:06:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:06:59 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:06:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Deleted volume successfully. Sep 04 19:06:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa1a15f1-f0c7-41b3-8211-61ef0f39c72b tempest-SnapshotsActionsTest-1786728269 None] Lock "cinder-30d021de-69b1-4ba2-9561-5e02dfdb1b59-delete_volume" released by "delete_volume" :: held 2.228s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:07:01 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_y_9w1pk5devstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90" returned: 0 in 2.982s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:01 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_y_9w1pk5devstack@QuobyteHD, size 112.00 MB, duration 2.98 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:07:01 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Converted 112.00 MB image at 37.55 MB/s Sep 04 19:07:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:01 devstack sudo[92892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90 1G Sep 04 19:07:01 devstack sudo[92892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:02 devstack sudo[92892]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90 1G" returned: 0 in 0.443s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Downloaded image e637b08c-391d-4edc-8402-9ba212deb71d ((None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}])) to volume 29b02ff7-8af3-45ff-9f9e-34821b34ef90 successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 19:07:02 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Temporary image e637b08c-391d-4edc-8402-9ba212deb71d for user 191fd840707244f8aa95a2379e85d05a is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 19:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Marking volume 29b02ff7-8af3-45ff-9f9e-34821b34ef90 as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 19:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Copying metadata from image e637b08c-391d-4edc-8402-9ba212deb71d to 29b02ff7-8af3-45ff-9f9e-34821b34ef90. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 19:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Creating volume glance metadata for volume 29b02ff7-8af3-45ff-9f9e-34821b34ef90 backed by image e637b08c-391d-4edc-8402-9ba212deb71d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 19:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57ea1802-592d-476a-97c0-83c343ecdf73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90', 'volume_size': 1, 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd0ece6d722f24154ab955bf866d06cbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'created_at': datetime.datetime(2026, 9, 4, 16, 58, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 58, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e637b08c-391d-4edc-8402-9ba212deb71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7c8efe-f763-4979-ab69-c975f0a6a3c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:02 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Volume volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90 (29b02ff7-8af3-45ff-9f9e-34821b34ef90): created successfully Sep 04 19:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b7c8efe-f763-4979-ab69-c975f0a6a3c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Flow 'volume_create_manager' (e4f2c57b-f247-402d-9f7f-b9ba96a9ce22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:07:02 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2f118203-874c-4805-96aa-b7d65d0be561 tempest-ServerActionsTestOtherA-1479936215 None] Created volume successfully. Sep 04 19:07:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bf896290-e8c7-4677-b473-0b5a1d2f7c7a req-d192087b-15cb-44be-85af-f395bbdbf8b7 tempest-ServerActionsTestOtherA-1479936215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:07:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bf896290-e8c7-4677-b473-0b5a1d2f7c7a req-d192087b-15cb-44be-85af-f395bbdbf8b7 tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:07:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bf896290-e8c7-4677-b473-0b5a1d2f7c7a req-d192087b-15cb-44be-85af-f395bbdbf8b7 tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:07:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bf896290-e8c7-4677-b473-0b5a1d2f7c7a req-d192087b-15cb-44be-85af-f395bbdbf8b7 tempest-ServerActionsTestOtherA-1479936215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e61a1059-39a7-4eea-a7e9-56c94920f05d', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:07:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-bf896290-e8c7-4677-b473-0b5a1d2f7c7a req-d192087b-15cb-44be-85af-f395bbdbf8b7 tempest-ServerActionsTestOtherA-1479936215 None] attachment_update completed successfully. Sep 04 19:07:17 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=21,cinder:INSERT=10,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:07:17 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=11,cinder:SELECT=11,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Flow 'volume_create_manager' (e4bfd9ce-d77b-4f14-8935-f22378f4e9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6958f9b1-831e-4c38-8646-96faf081338c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6958f9b1-831e-4c38-8646-96faf081338c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-287806026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf87b57a-2acf-43da-bcd8-796c7964a7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a561974405e742f0b459b4d1c25b6144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:07:19Z,use_quota=True,user_id='b49cbca22f6c463a8ecfa7ee117367df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8399796-6211-4478-8e1b-e84746494107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8399796-6211-4478-8e1b-e84746494107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a052b6f-2654-45bc-b006-b183f581dc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a052b6f-2654-45bc-b006-b183f581dc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf87b57a-2acf-43da-bcd8-796c7964a7e2', 'volume_name': 'volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a63fd08-d159-4784-b5bb-dd5113acf17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a63fd08-d159-4784-b5bb-dd5113acf17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8502ea-6930-4c63-a2f9-35d13728dc5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:18 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Volume bf87b57a-2acf-43da-bcd8-796c7964a7e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2', 'volume_size': 1} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:07:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-287806026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf87b57a-2acf-43da-bcd8-796c7964a7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a561974405e742f0b459b4d1c25b6144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:07:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:07:19Z,use_quota=True,user_id='b49cbca22f6c463a8ecfa7ee117367df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Creating volume bf87b57a-2acf-43da-bcd8-796c7964a7e2 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:07:18 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:07:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:18 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 1073741824 Sep 04 19:07:18 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:19 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 1073741824" returned: 0 in 0.807s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:19 devstack sudo[93085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 Sep 04 19:07:19 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:20 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2" returned: 0 in 0.651s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:07:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf8502ea-6930-4c63-a2f9-35d13728dc5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc11880-0674-4718-b20b-5d918a299716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:20 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Volume volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 (bf87b57a-2acf-43da-bcd8-796c7964a7e2): created successfully Sep 04 19:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc11880-0674-4718-b20b-5d918a299716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Flow 'volume_create_manager' (e4bfd9ce-d77b-4f14-8935-f22378f4e9a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:07:20 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-07df2208-28f4-4f31-a999-67ac3f482422 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Created volume successfully. Sep 04 19:07:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:07:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:07:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Creating offline snapshot 47ec0546-addf-488d-a00c-568e59fe2d77 of volume bf87b57a-2acf-43da-bcd8-796c7964a7e2 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:07:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[98379eb7-177a-4150-8b28-d0959273b2b2]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:07:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:21 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 Sep 04 19:07:21 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:22 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:07:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Flow 'volume_create_manager' (60437598-8772-46db-a487-0ffe806d06c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:07:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110e8896-d017-448a-a66c-4cc9631d039e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110e8896-d017-448a-a66c-4cc9631d039e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-42948241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51df7dd-8faf-4d9e-9e34-9630e7fc927f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba584b9bdeb49f0871854651f48e3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:07:22Z,use_quota=True,user_id='20e8ec456c23446787349e82f7c34b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489a1ab4-433b-4e9e-a5ac-a4021fab7f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (489a1ab4-433b-4e9e-a5ac-a4021fab7f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b73b074-a8f4-4669-85f5-17b5be273f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b73b074-a8f4-4669-85f5-17b5be273f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c51df7dd-8faf-4d9e-9e34-9630e7fc927f', 'volume_name': 'volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4503fb-f138-4b76-b76a-fa87fcd5af02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe4503fb-f138-4b76-b76a-fa87fcd5af02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541007dd-120c-4b50-9f08-4cc8d97c2e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:22 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Volume c51df7dd-8faf-4d9e-9e34-9630e7fc927f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f', 'volume_size': 1} Sep 04 19:07:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:07:22 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2" returned: 0 in 1.128s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:22 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77 1G Sep 04 19:07:22 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:23 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77 1G" returned: 0 in 0.914s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:23 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77 Sep 04 19:07:23 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:24 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77" returned: 0 in 0.583s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:24 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77 is being set with open permissions: ugo+rw Sep 04 19:07:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:24 devstack sudo[93153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77 Sep 04 19:07:24 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:24 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77" returned: 0 in 0.454s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:24 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.info Sep 04 19:07:24 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:25 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.info" returned: 0 in 0.453s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:25 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.info is being set with open permissions: ugo+rw Sep 04 19:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:25 devstack sudo[93160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.info Sep 04 19:07:25 devstack sudo[93160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:25 devstack sudo[93160]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.info" returned: 0 in 0.358s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.105s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.197s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-42948241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c51df7dd-8faf-4d9e-9e34-9630e7fc927f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba584b9bdeb49f0871854651f48e3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:07:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:07:22Z,use_quota=True,user_id='20e8ec456c23446787349e82f7c34b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Creating volume c51df7dd-8faf-4d9e-9e34-9630e7fc927f {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:07:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:07:25 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:07:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-69e98f60-8d47-44ca-add4-5c413b89bcc5 tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Create snapshot completed successfully Sep 04 19:07:25 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f 1073741824 Sep 04 19:07:25 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:26 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f 1073741824" returned: 0 in 1.052s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:26 devstack sudo[93169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f Sep 04 19:07:26 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Acquiring lock "cinder-47ec0546-addf-488d-a00c-568e59fe2d77-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "cinder-47ec0546-addf-488d-a00c-568e59fe2d77-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Acquiring lock "cinder-quobyte-bf87b57a-2acf-43da-bcd8-796c7964a7e2" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "cinder-quobyte-bf87b57a-2acf-43da-bcd8-796c7964a7e2" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Acquiring lock "cinder-quobyte-47ec0546-addf-488d-a00c-568e59fe2d77" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "cinder-quobyte-47ec0546-addf-488d-a00c-568e59fe2d77" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Deleting offline snapshot 47ec0546-addf-488d-a00c-568e59fe2d77 of volume bf87b57a-2acf-43da-bcd8-796c7964a7e2 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] snapshot_file for this snap is: volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4d7007-cd19-47f5-b28d-00fa615c0066]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:27 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f" returned: 0 in 0.550s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (541007dd-120c-4b50-9f08-4cc8d97c2e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7495e976-72f4-410c-861b-93d2339e4680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:27 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Volume volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f (c51df7dd-8faf-4d9e-9e34-9630e7fc927f): created successfully Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7495e976-72f4-410c-861b-93d2339e4680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Flow 'volume_create_manager' (60437598-8772-46db-a487-0ffe806d06c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:07:27 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b8177826-e208-40f5-8503-7a368601aeb4 tempest-AttachVolumeTestJSON-1764077708 None] Created volume successfully. Sep 04 19:07:27 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77 Sep 04 19:07:27 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:28 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77" returned: 0 in 0.715s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:07:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0225e79a-f1d2-49d0-bcb2-c99af3e6fd84]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:07:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:28 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 Sep 04 19:07:28 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:28 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2" returned: 0 in 0.562s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:28 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77 Sep 04 19:07:28 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-fdbc8e8b-e636-444e-953b-b733e77735e5 req-3648ae6d-1391-4324-9f18-8278d135d02a tempest-ServerActionsTestOtherA-1479936215 None] Terminate volume connection completed successfully. Sep 04 19:07:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-fdbc8e8b-e636-444e-953b-b733e77735e5 req-3648ae6d-1391-4324-9f18-8278d135d02a tempest-ServerActionsTestOtherA-1479936215 None] Deleting attachment e61a1059-39a7-4eea-a7e9-56c94920f05d. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:07:29 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77" returned: 0 in 0.714s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:29 devstack sudo[93215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77 Sep 04 19:07:29 devstack sudo[93215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:29 devstack sudo[93215]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2.47ec0546-addf-488d-a00c-568e59fe2d77" returned: 0 in 0.501s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "cinder-quobyte-47ec0546-addf-488d-a00c-568e59fe2d77" released by "_delete_snapshot" :: held 2.695s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:07:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "cinder-quobyte-bf87b57a-2acf-43da-bcd8-796c7964a7e2" released by "delete_snapshot" :: held 2.735s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:07:30 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Created reservations ['14fcb396-b5da-49aa-a73e-42dd41693056', '11d657b6-5fc1-4106-b41d-eb231f5b1739', '4007f725-0277-4fc4-832d-455f8fb6de9a', '83fec0ff-eedc-4657-a68c-4c1f1df93276'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:07:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Delete snapshot completed successfully. Sep 04 19:07:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b0c16dec-7c01-419a-9d3a-dbaf13734f9b tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "cinder-47ec0546-addf-488d-a00c-568e59fe2d77-delete_snapshot" released by "delete_snapshot" :: held 2.961s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:07:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-ae92615a-0eae-4e5a-b7d2-9cd5f5d329ba req-d4fd4cc9-a150-4cfe-a795-cdf2738a18d3 tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:07:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-ae92615a-0eae-4e5a-b7d2-9cd5f5d329ba req-d4fd4cc9-a150-4cfe-a795-cdf2738a18d3 tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:07:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-ae92615a-0eae-4e5a-b7d2-9cd5f5d329ba req-d4fd4cc9-a150-4cfe-a795-cdf2738a18d3 tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:07:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-ae92615a-0eae-4e5a-b7d2-9cd5f5d329ba req-d4fd4cc9-a150-4cfe-a795-cdf2738a18d3 tempest-AttachVolumeTestJSON-1764077708 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5efe0e3-1b23-457f-8501-bbf0dc5d62d9', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:07:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-ae92615a-0eae-4e5a-b7d2-9cd5f5d329ba req-d4fd4cc9-a150-4cfe-a795-cdf2738a18d3 tempest-AttachVolumeTestJSON-1764077708 None] attachment_update completed successfully. Sep 04 19:07:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Acquiring lock "cinder-bf87b57a-2acf-43da-bcd8-796c7964a7e2-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:07:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "cinder-bf87b57a-2acf-43da-bcd8-796c7964a7e2-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:07:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Acquiring lock "cinder-quobyte-bf87b57a-2acf-43da-bcd8-796c7964a7e2" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:07:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "cinder-quobyte-bf87b57a-2acf-43da-bcd8-796c7964a7e2" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:07:30 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[264fea01-8466-47e1-89e4-c2b3c5a2d2af]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:07:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:31 devstack sudo[93252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 Sep 04 19:07:31 devstack sudo[93252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:31 devstack sudo[93252]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2" returned: 0 in 0.451s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:31 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2 Sep 04 19:07:31 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-fdbc8e8b-e636-444e-953b-b733e77735e5 req-a64d623c-f217-4afe-a625-2bf5ba17b16e tempest-ServerActionsTestOtherA-1479936215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-fdbc8e8b-e636-444e-953b-b733e77735e5 req-a64d623c-f217-4afe-a625-2bf5ba17b16e tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-fdbc8e8b-e636-444e-953b-b733e77735e5 req-a64d623c-f217-4afe-a625-2bf5ba17b16e tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:07:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-fdbc8e8b-e636-444e-953b-b733e77735e5 req-a64d623c-f217-4afe-a625-2bf5ba17b16e tempest-ServerActionsTestOtherA-1479936215 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b45367e8-1fdc-44d6-ad88-a7844587e532', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:07:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-fdbc8e8b-e636-444e-953b-b733e77735e5 req-a64d623c-f217-4afe-a625-2bf5ba17b16e tempest-ServerActionsTestOtherA-1479936215 None] attachment_update completed successfully. Sep 04 19:07:31 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf87b57a-2acf-43da-bcd8-796c7964a7e2" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "cinder-quobyte-bf87b57a-2acf-43da-bcd8-796c7964a7e2" released by "delete_volume" :: held 0.821s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:07:31 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Created reservations ['91da4bc0-ceab-4f81-89b7-bce47ed5bb88', '9c13deff-54c1-4e75-9549-2008f2ea721c', '93a43483-ef2c-4dbc-9c32-9ad1027850ee', '40810e35-0a72-40a8-aeb9-ee88cff3c9fb'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:07:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:07:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:07:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:31 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:07:31 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:32 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.361s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:32 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:07:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Deleted volume successfully. Sep 04 19:07:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-493bb19a-03b8-4d00-b4ea-5d035412141a tempest-VolumeSnapshotQuotasNegativeTestJSON-1944430999 None] Lock "cinder-bf87b57a-2acf-43da-bcd8-796c7964a7e2-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:07:41 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=34,cinder:UPDATE=28,cinder:INSERT=3 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:07:42 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=20,cinder:INSERT=8,cinder:DELETE=4,cinder:SELECT=30 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:07:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:07:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:07:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-08665547-5137-4d07-ba91-a428a2e3a3cc req-512b3ebe-a1fb-477c-903d-3401b24a8be2 tempest-AttachVolumeNegativeTest-23207716 None] Terminate volume connection completed successfully. Sep 04 19:07:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-08665547-5137-4d07-ba91-a428a2e3a3cc req-512b3ebe-a1fb-477c-903d-3401b24a8be2 tempest-AttachVolumeNegativeTest-23207716 None] Deleting attachment f67ff6fb-61aa-496e-ba5c-96468f702d22. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Flow 'volume_create_manager' (0bcd41a3-28ef-4309-9415-27a0d788edff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a250323-ac60-4e00-bdbe-1ffdaef2da96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a250323-ac60-4e00-bdbe-1ffdaef2da96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-171216007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba482e2f-1b1b-428a-ba4b-95e34f558e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8da29b0dd424480963358e7a4ea5d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:07:55Z,use_quota=True,user_id='4189f503276141f98d29b8150931a3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6d446a-2a23-4a9e-899f-8f1da83a4bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb6d446a-2a23-4a9e-899f-8f1da83a4bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112a7f46-522c-4ad0-88d4-e8e90f59cc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (112a7f46-522c-4ad0-88d4-e8e90f59cc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba482e2f-1b1b-428a-ba4b-95e34f558e1b', 'volume_name': 'volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8f6483-9054-4a6e-bd74-48a71cb13de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd8f6483-9054-4a6e-bd74-48a71cb13de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a8e616-eb67-4125-8ba3-f86cbaf82bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:54 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Volume ba482e2f-1b1b-428a-ba4b-95e34f558e1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b', 'volume_size': 1} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:07:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-171216007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba482e2f-1b1b-428a-ba4b-95e34f558e1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8da29b0dd424480963358e7a4ea5d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:07:55Z,use_quota=True,user_id='4189f503276141f98d29b8150931a3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Creating volume ba482e2f-1b1b-428a-ba4b-95e34f558e1b {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:07:54 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:07:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:54 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b 1073741824 Sep 04 19:07:54 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:55 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b 1073741824" returned: 0 in 0.472s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:55 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b Sep 04 19:07:55 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:55 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b" returned: 0 in 0.306s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:07:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:07:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a8e616-eb67-4125-8ba3-f86cbaf82bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446ba8a6-0ab7-4cf6-a682-de51042e1345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:07:55 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Volume volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b (ba482e2f-1b1b-428a-ba4b-95e34f558e1b): created successfully Sep 04 19:07:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446ba8a6-0ab7-4cf6-a682-de51042e1345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:07:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Flow 'volume_create_manager' (0bcd41a3-28ef-4309-9415-27a0d788edff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:07:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9e79e949-19d6-467d-abf9-2aa04e98f131 tempest-VolumesDeleteCascade-478275680 None] Created volume successfully. Sep 04 19:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:07:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:07:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] Creating offline snapshot 7c4b7bab-5922-43d1-b801-81e344085f93 of volume ba482e2f-1b1b-428a-ba4b-95e34f558e1b {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:07:56 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9188bc20-9922-4057-9b8c-32428f09a0c7]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:57 devstack sudo[93551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b Sep 04 19:07:57 devstack sudo[93551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:57 devstack sudo[93551]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b" returned: 0 in 0.387s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:57 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 1G Sep 04 19:07:57 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:57 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 1G" returned: 0 in 0.466s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:57 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 Sep 04 19:07:57 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:58 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93" returned: 0 in 0.297s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:58 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 is being set with open permissions: ugo+rw Sep 04 19:07:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:58 devstack sudo[93567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 Sep 04 19:07:58 devstack sudo[93567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:58 devstack sudo[93567]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93" returned: 0 in 0.255s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:58 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.info Sep 04 19:07:58 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:58 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.info" returned: 0 in 0.248s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:58 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.info is being set with open permissions: ugo+rw Sep 04 19:07:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:07:58 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.info Sep 04 19:07:58 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:07:58 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Sep 04 19:07:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.info" returned: 0 in 0.268s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:07:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.024s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:07:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-acc07afd-d245-417f-8fca-cb28b3f6f908 tempest-VolumesDeleteCascade-478275680 None] Create snapshot completed successfully Sep 04 19:08:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2f1985c3-91ce-48ef-bb01-25bf5c45452f tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2f1985c3-91ce-48ef-bb01-25bf5c45452f tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2f1985c3-91ce-48ef-bb01-25bf5c45452f tempest-VolumesDeleteCascade-478275680 None] Creating offline snapshot e813f9a6-02e2-4bd2-a141-d71381bce0f2 of volume ba482e2f-1b1b-428a-ba4b-95e34f558e1b {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:08:00 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f99e3b-43bc-499c-a553-18f8ac5b8736]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f1985c3-91ce-48ef-bb01-25bf5c45452f tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:00 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 Sep 04 19:08:00 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:00 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f1985c3-91ce-48ef-bb01-25bf5c45452f tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93" returned: 0 in 0.400s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2f1985c3-91ce-48ef-bb01-25bf5c45452f tempest-VolumesDeleteCascade-478275680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:08:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f1985c3-91ce-48ef-bb01-25bf5c45452f tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:00 devstack sudo[93597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 1G Sep 04 19:08:00 devstack sudo[93597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:01 devstack sudo[93597]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f1985c3-91ce-48ef-bb01-25bf5c45452f tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 1G" returned: 0 in 0.502s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f1985c3-91ce-48ef-bb01-25bf5c45452f tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:01 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 Sep 04 19:08:01 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:01 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f1985c3-91ce-48ef-bb01-25bf5c45452f tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2" returned: 0 in 0.310s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:01 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-2f1985c3-91ce-48ef-bb01-25bf5c45452f tempest-VolumesDeleteCascade-478275680 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 is being set with open permissions: ugo+rw Sep 04 19:08:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f1985c3-91ce-48ef-bb01-25bf5c45452f tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:01 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 Sep 04 19:08:01 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:01 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f1985c3-91ce-48ef-bb01-25bf5c45452f tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2" returned: 0 in 0.247s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2f1985c3-91ce-48ef-bb01-25bf5c45452f tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.561s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2f1985c3-91ce-48ef-bb01-25bf5c45452f tempest-VolumesDeleteCascade-478275680 None] Create snapshot completed successfully Sep 04 19:08:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-ba482e2f-1b1b-428a-ba4b-95e34f558e1b-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-ba482e2f-1b1b-428a-ba4b-95e34f558e1b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Performing cascade delete. {{(pid=87560) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 04 19:08:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-7c4b7bab-5922-43d1-b801-81e344085f93-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-7c4b7bab-5922-43d1-b801-81e344085f93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-quobyte-ba482e2f-1b1b-428a-ba4b-95e34f558e1b" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-ba482e2f-1b1b-428a-ba4b-95e34f558e1b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-quobyte-7c4b7bab-5922-43d1-b801-81e344085f93" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-7c4b7bab-5922-43d1-b801-81e344085f93" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Deleting offline snapshot 7c4b7bab-5922-43d1-b801-81e344085f93 of volume ba482e2f-1b1b-428a-ba4b-95e34f558e1b {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:08:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] snapshot_file for this snap is: volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:08:02 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[89db43c7-3193-4234-8459-5e9dae96cb5f]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:03 devstack sudo[93619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 Sep 04 19:08:03 devstack sudo[93619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:03 devstack sudo[93619]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93" returned: 0 in 0.899s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:08:03 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f784fcf-e3eb-4735-9ce0-7961350b4e39]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:04 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b Sep 04 19:08:04 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:04 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b" returned: 0 in 0.789s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:04 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[158d08a6-99ea-4a02-a8f7-26f2cfb6c758]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:04 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 Sep 04 19:08:04 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:05 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2" returned: 0 in 0.436s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:08:05 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e782d25-8743-4457-a51f-7ec282ed8964]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:05 devstack sudo[93713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 Sep 04 19:08:05 devstack sudo[93713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:06 devstack sudo[93713]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93" returned: 0 in 0.866s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:08:06 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa6ad07-625b-48ae-8110-65696350c546]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:06 devstack sudo[93719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b Sep 04 19:08:06 devstack sudo[93719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-9f8e7501-e93e-403a-a256-d96bdb43672d req-d0efad03-51b2-49ab-8170-3313ecdd2317 tempest-AttachVolumeTestJSON-1764077708 None] Terminate volume connection completed successfully. Sep 04 19:08:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-9f8e7501-e93e-403a-a256-d96bdb43672d req-d0efad03-51b2-49ab-8170-3313ecdd2317 tempest-AttachVolumeTestJSON-1764077708 None] Deleting attachment b5efe0e3-1b23-457f-8501-bbf0dc5d62d9. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:08:06 devstack sudo[93719]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b" returned: 0 in 0.738s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:06 devstack sudo[93727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 Sep 04 19:08:06 devstack sudo[93727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:07 devstack sudo[93727]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93" returned: 0 in 0.814s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:07 devstack sudo[93751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93 Sep 04 19:08:07 devstack sudo[93751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:08 devstack sudo[93751]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.7c4b7bab-5922-43d1-b801-81e344085f93" returned: 0 in 0.698s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 -F qcow2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:08 devstack sudo[93764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 -F qcow2 Sep 04 19:08:08 devstack sudo[93764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:08 devstack sudo[93764]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 -F qcow2" returned: 0 in 0.378s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-7c4b7bab-5922-43d1-b801-81e344085f93" released by "_delete_snapshot" :: held 5.939s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-ba482e2f-1b1b-428a-ba4b-95e34f558e1b" released by "delete_snapshot" :: held 5.997s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:08 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Created reservations ['9bc8b92f-4a36-453c-bd22-620619b705b4', 'd213e076-1de7-464b-9527-26c00d93b573', 'ffde064f-49a2-40c3-902e-ecb691408106', '61ffbb51-55e0-4daf-bf1f-07936232f4aa'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:08:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Delete snapshot completed successfully. Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-7c4b7bab-5922-43d1-b801-81e344085f93-delete_snapshot" released by "delete_snapshot" :: held 6.305s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-e813f9a6-02e2-4bd2-a141-d71381bce0f2-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-e813f9a6-02e2-4bd2-a141-d71381bce0f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-quobyte-ba482e2f-1b1b-428a-ba4b-95e34f558e1b" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-ba482e2f-1b1b-428a-ba4b-95e34f558e1b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-quobyte-e813f9a6-02e2-4bd2-a141-d71381bce0f2" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-e813f9a6-02e2-4bd2-a141-d71381bce0f2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Deleting offline snapshot e813f9a6-02e2-4bd2-a141-d71381bce0f2 of volume ba482e2f-1b1b-428a-ba4b-95e34f558e1b {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] snapshot_file for this snap is: volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ed1084-2836-4dbd-8389-0c34db3c539c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:09 devstack sudo[93771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 Sep 04 19:08:09 devstack sudo[93771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-b6e78111-479b-4bae-9545-1b58b7c75352 tempest-ServerActionsTestOtherA-1479936215 None] Terminate volume connection completed successfully. Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-b6e78111-479b-4bae-9545-1b58b7c75352 tempest-ServerActionsTestOtherA-1479936215 None] Deleting attachment b45367e8-1fdc-44d6-ad88-a7844587e532. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Acquiring lock "cinder-29b02ff7-8af3-45ff-9f9e-34821b34ef90-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Lock "cinder-29b02ff7-8af3-45ff-9f9e-34821b34ef90-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:09 devstack sudo[93771]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2" returned: 0 in 0.569s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf428e4d-ccb9-4e7b-816e-e5254014cf0c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Acquiring lock "cinder-quobyte-29b02ff7-8af3-45ff-9f9e-34821b34ef90" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Lock "cinder-quobyte-29b02ff7-8af3-45ff-9f9e-34821b34ef90" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a038e876-b00b-4bcd-8aae-1f368aa90c8c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:09 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b Sep 04 19:08:09 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:09 devstack sudo[93779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90 Sep 04 19:08:09 devstack sudo[93779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:10 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b" returned: 0 in 0.417s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:10 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 Sep 04 19:08:10 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:10 devstack sudo[93779]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90" returned: 0 in 0.493s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:10 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90 Sep 04 19:08:10 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:10 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2" returned: 0 in 0.550s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:10 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-29b02ff7-8af3-45ff-9f9e-34821b34ef90" returned: 0 in 0.419s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Lock "cinder-quobyte-29b02ff7-8af3-45ff-9f9e-34821b34ef90" released by "delete_volume" :: held 0.985s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:10 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2 Sep 04 19:08:10 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Acquiring lock "cinder-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:10 devstack cinder-volume[87560]: DEBUG cinder.quota [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Created reservations ['d55edc1e-a825-4aa8-8b21-be22b001e094', 'c906ad6a-e3bb-4b0a-8ae0-885d955dd8c5', 'd52398c5-37e8-445e-835c-5c2b76edeb25', '4b661438-6b2b-47c3-a825-22d841e30469'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:08:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Lock "cinder-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Acquiring lock "cinder-quobyte-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Lock "cinder-quobyte-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256" acquired by "delete_volume" :: waited 0.090s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bc3f7f-f67b-41b7-8e22-9d09cded2e75]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:11 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:11 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:08:11 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b.e813f9a6-02e2-4bd2-a141-d71381bce0f2" returned: 0 in 0.479s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-e813f9a6-02e2-4bd2-a141-d71381bce0f2" released by "_delete_snapshot" :: held 2.183s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-ba482e2f-1b1b-428a-ba4b-95e34f558e1b" released by "delete_snapshot" :: held 2.225s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:11 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256 Sep 04 19:08:11 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Created reservations ['46635692-a5a3-428b-86df-c98ea161b691', 'dd613614-ada9-4fee-bc91-6795fd4d5e23', '41173b2f-7528-41f8-9829-c3a1a100d284', '9aaa20a3-fb3f-4039-98c4-89f7b20ded0e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:08:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Delete snapshot completed successfully. Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-e813f9a6-02e2-4bd2-a141-d71381bce0f2-delete_snapshot" released by "delete_snapshot" :: held 2.550s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Snapshots deleted, issuing volume delete {{(pid=87560) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-quobyte-ba482e2f-1b1b-428a-ba4b-95e34f558e1b" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-ba482e2f-1b1b-428a-ba4b-95e34f558e1b" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a76ef8d-edab-4806-b7dc-1325b0299bcb]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:11 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.581s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG cinder.manager [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:08:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Deleted volume successfully. Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-499f5b3b-3f0c-443f-8179-042c9fae19ab req-4d0862ff-07e1-464e-8ddd-ab4729340db1 tempest-ServerActionsTestOtherA-1479936215 None] Lock "cinder-29b02ff7-8af3-45ff-9f9e-34821b34ef90-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:11 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256" returned: 0 in 0.799s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:11 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b Sep 04 19:08:11 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:12 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256 Sep 04 19:08:12 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:12 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256" returned: 0 in 0.415s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Lock "cinder-quobyte-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256" released by "delete_volume" :: held 1.321s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:12 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Created reservations ['f6371b49-85f6-4ec7-a268-3520903d1db2', 'ac7dcdaf-b81c-4978-957a-4bd5b34a88e1', 'cc11296d-0788-4995-9018-7cfcb72ed498', '312c9402-a99b-4710-961a-b62dbcc6efc7'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:08:12 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b" returned: 0 in 0.831s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:12 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b Sep 04 19:08:12 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:08:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:08:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:12 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:08:12 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:13 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba482e2f-1b1b-428a-ba4b-95e34f558e1b" returned: 0 in 0.727s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-ba482e2f-1b1b-428a-ba4b-95e34f558e1b" released by "delete_volume" :: held 1.688s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:13 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Created reservations ['237f9054-218e-4c08-9a9a-21d112c063c9', '7a573306-66d0-44b9-b7b5-bd46bfd0544b', 'a6e32445-c1aa-41c9-ad80-61d32307e265', 'd05e047f-57af-484c-9f10-5f9a8b9f0f40'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:08:13 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.664s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:13 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:08:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:08:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:08:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Deleted volume successfully. Sep 04 19:08:13 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:08:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f90c5db6-8e10-43aa-956f-e994d213f8cb tempest-ServerActionsTestOtherA-1479936215 None] Lock "cinder-ec5467a9-8d8c-4c57-b3ca-6fd2d9ec7256-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:13 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:14 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.642s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:14 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:08:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Deleted volume successfully. Sep 04 19:08:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-da0e7c75-ee71-4373-8922-06d9abf0fcb5 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-ba482e2f-1b1b-428a-ba4b-95e34f558e1b-delete_volume" released by "delete_volume" :: held 11.709s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Flow 'volume_create_manager' (a4affe16-1e5e-424e-bde2-e792a6d40571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f8a981-2250-4fde-aada-1e13642b537c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f8a981-2250-4fde-aada-1e13642b537c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-888939967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa42031-735b-46d6-b24e-5942104e8ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8da29b0dd424480963358e7a4ea5d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:08:16Z,use_quota=True,user_id='4189f503276141f98d29b8150931a3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d7aa4e1-2252-4f75-a00e-6ef929bef2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d7aa4e1-2252-4f75-a00e-6ef929bef2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5b0da0-58b4-4b7e-a586-be9e6af2b6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5b0da0-58b4-4b7e-a586-be9e6af2b6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fa42031-735b-46d6-b24e-5942104e8ea3', 'volume_name': 'volume-5fa42031-735b-46d6-b24e-5942104e8ea3', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89a383c-5dd4-4db5-9296-3aabc832e55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d89a383c-5dd4-4db5-9296-3aabc832e55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2793af18-529e-4278-8607-c5b511098e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:16 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Volume 5fa42031-735b-46d6-b24e-5942104e8ea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fa42031-735b-46d6-b24e-5942104e8ea3', 'volume_size': 1} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-888939967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fa42031-735b-46d6-b24e-5942104e8ea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8da29b0dd424480963358e7a4ea5d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:08:16Z,use_quota=True,user_id='4189f503276141f98d29b8150931a3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Creating volume 5fa42031-735b-46d6-b24e-5942104e8ea3 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:08:16 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:08:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:16 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 1073741824 Sep 04 19:08:16 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:17 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 1073741824" returned: 0 in 1.166s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:17 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 Sep 04 19:08:17 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:18 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3" returned: 0 in 0.409s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:08:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2793af18-529e-4278-8607-c5b511098e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fa42031-735b-46d6-b24e-5942104e8ea3', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20eda8cd-dd95-4570-b684-e72dbc1b7902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:18 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Volume volume-5fa42031-735b-46d6-b24e-5942104e8ea3 (5fa42031-735b-46d6-b24e-5942104e8ea3): created successfully Sep 04 19:08:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20eda8cd-dd95-4570-b684-e72dbc1b7902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Flow 'volume_create_manager' (a4affe16-1e5e-424e-bde2-e792a6d40571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:08:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-475be3f8-ddc3-437c-9249-f78e68c8133f tempest-VolumesDeleteCascade-478275680 None] Created volume successfully. Sep 04 19:08:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] Creating offline snapshot 3f843118-525e-4f85-9aed-f5fbf06c6730 of volume 5fa42031-735b-46d6-b24e-5942104e8ea3 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:08:19 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebfd617-c73e-480d-a503-dd55146c1ac9]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:19 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 Sep 04 19:08:19 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:20 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3" returned: 0 in 0.431s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:20 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 1G Sep 04 19:08:20 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:20 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 1G" returned: 0 in 0.426s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fa42031-735b-46d6-b24e-5942104e8ea3 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:20 devstack sudo[93990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fa42031-735b-46d6-b24e-5942104e8ea3 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 Sep 04 19:08:20 devstack sudo[93990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:20 devstack sudo[93990]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5fa42031-735b-46d6-b24e-5942104e8ea3 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730" returned: 0 in 0.320s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:20 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 is being set with open permissions: ugo+rw Sep 04 19:08:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:20 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 Sep 04 19:08:20 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:21 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730" returned: 0 in 0.235s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:21 devstack sudo[93999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.info Sep 04 19:08:21 devstack sudo[93999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:21 devstack sudo[93999]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.info" returned: 0 in 0.239s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:21 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.info is being set with open permissions: ugo+rw Sep 04 19:08:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:21 devstack sudo[94003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.info Sep 04 19:08:21 devstack sudo[94003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:21 devstack sudo[94003]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.info" returned: 0 in 0.248s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.025s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:21 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4fdd7d01-707b-403b-b31f-dc0e60e47301 tempest-VolumesDeleteCascade-478275680 None] Create snapshot completed successfully Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Flow 'volume_create_manager' (8c3616e0-4920-4265-b75e-9fbf95ade261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d8c7fb-f8e2-4cc4-9275-85b9f533b5ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33d8c7fb-f8e2-4cc4-9275-85b9f533b5ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-447573756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44ded2a4-585a-464e-a0f8-b8d10b86cc17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8da29b0dd424480963358e7a4ea5d5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3f843118-525e-4f85-9aed-f5fbf06c6730,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:08:23Z,use_quota=True,user_id='4189f503276141f98d29b8150931a3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2e8442-c827-46d8-9b89-08f3a8b59835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2e8442-c827-46d8-9b89-08f3a8b59835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1030ea9d-3deb-4100-b46d-e6c922ce6471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1030ea9d-3deb-4100-b46d-e6c922ce6471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '44ded2a4-585a-464e-a0f8-b8d10b86cc17', 'volume_name': 'volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17', 'volume_size': 1, 'snapshot_id': '3f843118-525e-4f85-9aed-f5fbf06c6730'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b918f14a-eb7f-442f-a023-4d0f250c1a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b918f14a-eb7f-442f-a023-4d0f250c1a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bee0a8-9a97-4fbb-8d8f-34f5c59c3f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:23 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Volume 44ded2a4-585a-464e-a0f8-b8d10b86cc17: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17', 'volume_size': 1, 'snapshot_id': '3f843118-525e-4f85-9aed-f5fbf06c6730'} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-quobyte-3f843118-525e-4f85-9aed-f5fbf06c6730-44ded2a4-585a-464e-a0f8-b8d10b86cc17" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-3f843118-525e-4f85-9aed-f5fbf06c6730-44ded2a4-585a-464e-a0f8-b8d10b86cc17" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Creating volume 44ded2a4-585a-464e-a0f8-b8d10b86cc17 from snapshot 3f843118-525e-4f85-9aed-f5fbf06c6730 {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-quobyte-44ded2a4-585a-464e-a0f8-b8d10b86cc17" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-44ded2a4-585a-464e-a0f8-b8d10b86cc17" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] snapshot: 3f843118-525e-4f85-9aed-f5fbf06c6730, volume: 44ded2a4-585a-464e-a0f8-b8d10b86cc17, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afaea69-017b-4b19-80e9-7b10ea6093ce]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:23 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 Sep 04 19:08:23 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:24 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730" returned: 0 in 0.489s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fa42031-735b-46d6-b24e-5942104e8ea3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:08:24 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec401861-40ca-46dc-ad74-91cf2f099864]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:24 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 Sep 04 19:08:24 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:24 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3" returned: 0 in 0.554s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 19:08:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 19:08:24 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Path /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17 not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 19:08:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:24 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17 Sep 04 19:08:24 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:31 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17" returned: 0 in 6.908s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:31 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3, size 1024.00 MB, duration 6.91 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:08:31 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Converted 1024.00 MB image at 148.13 MB/s Sep 04 19:08:31 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17 is being set with open permissions: ugo+rw Sep 04 19:08:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:31 devstack sudo[94071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17 Sep 04 19:08:31 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:31 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17" returned: 0 in 0.297s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-44ded2a4-585a-464e-a0f8-b8d10b86cc17" released by "_copy_volume_from_snapshot" :: held 8.352s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-3f843118-525e-4f85-9aed-f5fbf06c6730-44ded2a4-585a-464e-a0f8-b8d10b86cc17" released by "_create_volume_from_snapshot" :: held 8.437s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.471s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3bee0a8-9a97-4fbb-8d8f-34f5c59c3f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17', 'volume_size': 1, 'snapshot_id': '3f843118-525e-4f85-9aed-f5fbf06c6730'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed19fa2a-85eb-49ae-92bf-e1c0f1e5cf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:32 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Volume volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17 (44ded2a4-585a-464e-a0f8-b8d10b86cc17): created successfully Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed19fa2a-85eb-49ae-92bf-e1c0f1e5cf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Flow 'volume_create_manager' (8c3616e0-4920-4265-b75e-9fbf95ade261) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:08:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b7c692c2-6599-4f24-8896-59202fdaa244 tempest-VolumesDeleteCascade-478275680 None] Created volume successfully. Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Flow 'volume_create_manager' (b7890a91-37ce-483c-9c66-ce8c71a44593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81728cb6-725e-468f-88cd-6e98319a1015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81728cb6-725e-468f-88cd-6e98319a1015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1182643420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=616c3adf-018a-4ea5-adfe-206cf9de9425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a13e1b4d78647559438efc43d7815c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:08:32Z,use_quota=True,user_id='0374ed63eb9c4ac1bfecef338246062f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de6089ce-249f-442c-b649-42989cdf2da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de6089ce-249f-442c-b649-42989cdf2da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee91784-53bb-4139-a5b9-dabe0b69766b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee91784-53bb-4139-a5b9-dabe0b69766b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '616c3adf-018a-4ea5-adfe-206cf9de9425', 'volume_name': 'volume-616c3adf-018a-4ea5-adfe-206cf9de9425', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe4e035-4b38-4a53-9d7c-ae3cf27e3767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe4e035-4b38-4a53-9d7c-ae3cf27e3767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (765063bf-993a-47f8-9101-2b37e679bf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:32 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Volume 616c3adf-018a-4ea5-adfe-206cf9de9425: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-616c3adf-018a-4ea5-adfe-206cf9de9425', 'volume_size': 1} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1182643420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=616c3adf-018a-4ea5-adfe-206cf9de9425,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a13e1b4d78647559438efc43d7815c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:08:32Z,use_quota=True,user_id='0374ed63eb9c4ac1bfecef338246062f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Creating volume 616c3adf-018a-4ea5-adfe-206cf9de9425 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:08:32 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-616c3adf-018a-4ea5-adfe-206cf9de9425 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:32 devstack sudo[94074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-616c3adf-018a-4ea5-adfe-206cf9de9425 1073741824 Sep 04 19:08:32 devstack sudo[94074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:32 devstack sudo[94074]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-616c3adf-018a-4ea5-adfe-206cf9de9425 1073741824" returned: 0 in 0.476s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-616c3adf-018a-4ea5-adfe-206cf9de9425 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:32 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-616c3adf-018a-4ea5-adfe-206cf9de9425 Sep 04 19:08:32 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-5fa42031-735b-46d6-b24e-5942104e8ea3-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-5fa42031-735b-46d6-b24e-5942104e8ea3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Performing cascade delete. {{(pid=87560) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-3f843118-525e-4f85-9aed-f5fbf06c6730-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-3f843118-525e-4f85-9aed-f5fbf06c6730-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-quobyte-5fa42031-735b-46d6-b24e-5942104e8ea3" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-5fa42031-735b-46d6-b24e-5942104e8ea3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-quobyte-3f843118-525e-4f85-9aed-f5fbf06c6730" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-3f843118-525e-4f85-9aed-f5fbf06c6730" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Deleting offline snapshot 3f843118-525e-4f85-9aed-f5fbf06c6730 of volume 5fa42031-735b-46d6-b24e-5942104e8ea3 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] snapshot_file for this snap is: volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[23328d82-f4d4-46bc-b73b-1ae072928eaa]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:33 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-616c3adf-018a-4ea5-adfe-206cf9de9425" returned: 0 in 0.348s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (765063bf-993a-47f8-9101-2b37e679bf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-616c3adf-018a-4ea5-adfe-206cf9de9425', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2304342e-ff5c-4daa-8008-310e582146bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:33 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Volume volume-616c3adf-018a-4ea5-adfe-206cf9de9425 (616c3adf-018a-4ea5-adfe-206cf9de9425): created successfully Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2304342e-ff5c-4daa-8008-310e582146bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Flow 'volume_create_manager' (b7890a91-37ce-483c-9c66-ce8c71a44593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:08:33 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1a815125-9125-4ad6-8fd8-9d6eaedd1d6a tempest-AttachVolumeNegativeTest-23207716 None] Created volume successfully. Sep 04 19:08:33 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 Sep 04 19:08:33 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:33 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730" returned: 0 in 0.403s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5fa42031-735b-46d6-b24e-5942104e8ea3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a5032e-295d-47cf-9aca-a96444b0fb35]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:33 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 Sep 04 19:08:33 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:34 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3" returned: 0 in 0.528s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:34 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 Sep 04 19:08:34 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:34 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730" returned: 0 in 0.375s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:34 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730 Sep 04 19:08:34 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:34 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3.3f843118-525e-4f85-9aed-f5fbf06c6730" returned: 0 in 0.267s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-3f843118-525e-4f85-9aed-f5fbf06c6730" released by "_delete_snapshot" :: held 1.695s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-5fa42031-735b-46d6-b24e-5942104e8ea3" released by "delete_snapshot" :: held 1.723s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:34 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Created reservations ['f00dd918-c24c-4577-9b42-8b5e149f1f3b', '91acaa3f-c70b-49c9-979c-7e6e26030914', '191866cc-19f2-4831-83cb-f7620bd35732', '130d9ab2-9409-40ba-87de-5fdf962fb9ff'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:08:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Delete snapshot completed successfully. Sep 04 19:08:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-3f843118-525e-4f85-9aed-f5fbf06c6730-delete_snapshot" released by "delete_snapshot" :: held 1.931s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Snapshots deleted, issuing volume delete {{(pid=87560) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 04 19:08:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-quobyte-5fa42031-735b-46d6-b24e-5942104e8ea3" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-5fa42031-735b-46d6-b24e-5942104e8ea3" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:34 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[137e9ad8-e8f8-4e53-823d-1978d3c6976c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:35 devstack sudo[94107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 Sep 04 19:08:35 devstack sudo[94107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-dcdb50b0-5d81-4015-9eaf-9d2e1ea7b699 req-8f353658-c509-4cfb-95a2-97f687ddfad2 tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-dcdb50b0-5d81-4015-9eaf-9d2e1ea7b699 req-8f353658-c509-4cfb-95a2-97f687ddfad2 tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-dcdb50b0-5d81-4015-9eaf-9d2e1ea7b699 req-8f353658-c509-4cfb-95a2-97f687ddfad2 tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-dcdb50b0-5d81-4015-9eaf-9d2e1ea7b699 req-8f353658-c509-4cfb-95a2-97f687ddfad2 tempest-AttachVolumeNegativeTest-23207716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-616c3adf-018a-4ea5-adfe-206cf9de9425', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '44b8813c-24e9-458d-876c-52dad6193534', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:08:35 devstack sudo[94107]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3" returned: 0 in 0.454s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:35 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3 Sep 04 19:08:35 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-dcdb50b0-5d81-4015-9eaf-9d2e1ea7b699 req-8f353658-c509-4cfb-95a2-97f687ddfad2 tempest-AttachVolumeNegativeTest-23207716 None] attachment_update completed successfully. Sep 04 19:08:35 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5fa42031-735b-46d6-b24e-5942104e8ea3" returned: 0 in 0.343s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-5fa42031-735b-46d6-b24e-5942104e8ea3" released by "delete_volume" :: held 0.876s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:35 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Created reservations ['84effa95-6378-46f8-a8a9-df119faf33db', 'b2588f51-54fb-4fbd-a8f7-645574b30725', '66d85ed8-7f49-4a9c-8847-b9802dfec674', 'e81e0fb5-e6c6-423c-af46-d048b4eeaa93'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:08:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:08:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:08:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:36 devstack sudo[94506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:08:36 devstack sudo[94506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:36 devstack sudo[94506]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.412s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:36 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:08:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Deleted volume successfully. Sep 04 19:08:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee654a34-22d3-47ef-ab2f-e494e1aab8e2 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-5fa42031-735b-46d6-b24e-5942104e8ea3-delete_volume" released by "delete_volume" :: held 3.564s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-44ded2a4-585a-464e-a0f8-b8d10b86cc17-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-44ded2a4-585a-464e-a0f8-b8d10b86cc17-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "cinder-quobyte-44ded2a4-585a-464e-a0f8-b8d10b86cc17" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-44ded2a4-585a-464e-a0f8-b8d10b86cc17" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:36 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4bcb67-217c-42e2-b7ca-021bbd50f59a]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:36 devstack sudo[94509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17 Sep 04 19:08:36 devstack sudo[94509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:37 devstack sudo[94509]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17" returned: 0 in 0.628s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:37 devstack sudo[94515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17 Sep 04 19:08:37 devstack sudo[94515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:37 devstack sudo[94515]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44ded2a4-585a-464e-a0f8-b8d10b86cc17" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-quobyte-44ded2a4-585a-464e-a0f8-b8d10b86cc17" released by "delete_volume" :: held 0.953s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:37 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Created reservations ['4ef806c4-e47c-42e4-8889-3167fcf1bc2b', '3d0342a0-1ce6-4a82-9773-2c90744b6943', '8171b451-dd01-4ecb-8604-d462319ffe1a', '5d12676f-1721-4354-88b7-63fd05da8e41'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:08:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:08:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:08:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:37 devstack sudo[94519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:08:37 devstack sudo[94519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:38 devstack sudo[94519]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.298s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:38 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:08:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Deleted volume successfully. Sep 04 19:08:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-caf433fb-ef30-4d0a-9fce-217941abf822 req-da953d5a-5995-4a97-b4de-1d2c7f465ebf tempest-AttachVolumeNegativeTest-23207716 None] Terminate volume connection completed successfully. Sep 04 19:08:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-caf433fb-ef30-4d0a-9fce-217941abf822 req-da953d5a-5995-4a97-b4de-1d2c7f465ebf tempest-AttachVolumeNegativeTest-23207716 None] Deleting attachment 44b8813c-24e9-458d-876c-52dad6193534. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:08:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f86ef2fb-22a5-41b0-8c83-575938e634a3 tempest-VolumesDeleteCascade-478275680 None] Lock "cinder-44ded2a4-585a-464e-a0f8-b8d10b86cc17-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:43 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=66,cinder:UPDATE=71,cinder:INSERT=20,cinder:DELETE=6 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:08:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:08:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:08:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:08:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:45 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:08:45 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:45 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.363s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:08:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:08:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:08:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Flow 'volume_create_manager' (5064644c-d376-48bd-836e-e0eaca1b0752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3037ce-8e45-47a7-afd4-e71734a3d07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e3037ce-8e45-47a7-afd4-e71734a3d07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1390842279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31768306-2ec2-4197-9ec5-93c9bab7305c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73526ffeb40547aa9caa82f485c74cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:08:46Z,use_quota=True,user_id='33247e7ee57441e9bed3336048cf66c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bfe02a4-2ec5-49b3-a4d5-ebe9176cbaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bfe02a4-2ec5-49b3-a4d5-ebe9176cbaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2644bdd-2313-4e05-8e3d-4889eeafe575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2644bdd-2313-4e05-8e3d-4889eeafe575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31768306-2ec2-4197-9ec5-93c9bab7305c', 'volume_name': 'volume-31768306-2ec2-4197-9ec5-93c9bab7305c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a45487c-093c-462f-8b74-3dc4e28ed145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a45487c-093c-462f-8b74-3dc4e28ed145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050bf86c-3e56-4e50-9a6a-c53a6f0b9387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:46 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Volume 31768306-2ec2-4197-9ec5-93c9bab7305c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31768306-2ec2-4197-9ec5-93c9bab7305c', 'volume_size': 1} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1390842279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31768306-2ec2-4197-9ec5-93c9bab7305c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73526ffeb40547aa9caa82f485c74cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:08:46Z,use_quota=True,user_id='33247e7ee57441e9bed3336048cf66c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Creating volume 31768306-2ec2-4197-9ec5-93c9bab7305c {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:08:46 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:08:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31768306-2ec2-4197-9ec5-93c9bab7305c 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:46 devstack sudo[94602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31768306-2ec2-4197-9ec5-93c9bab7305c 1073741824 Sep 04 19:08:46 devstack sudo[94602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:47 devstack sudo[94602]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31768306-2ec2-4197-9ec5-93c9bab7305c 1073741824" returned: 0 in 0.608s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31768306-2ec2-4197-9ec5-93c9bab7305c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:47 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31768306-2ec2-4197-9ec5-93c9bab7305c Sep 04 19:08:47 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:47 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31768306-2ec2-4197-9ec5-93c9bab7305c" returned: 0 in 0.276s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:08:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (050bf86c-3e56-4e50-9a6a-c53a6f0b9387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31768306-2ec2-4197-9ec5-93c9bab7305c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5445a51b-4c72-4763-a2a2-4d9c785436bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:47 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Volume volume-31768306-2ec2-4197-9ec5-93c9bab7305c (31768306-2ec2-4197-9ec5-93c9bab7305c): created successfully Sep 04 19:08:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5445a51b-4c72-4763-a2a2-4d9c785436bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Flow 'volume_create_manager' (5064644c-d376-48bd-836e-e0eaca1b0752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:08:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-51167d05-bf0b-43d3-8ef4-cab1f469bdd0 tempest-VolumesTransfersTest-1204170846 None] Created volume successfully. Sep 04 19:08:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a968b240-8556-4c6d-b890-cb6f0ab7561d tempest-VolumesTransfersTest-1781472495 None] Transfer volume completed successfully. Sep 04 19:08:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Acquiring lock "cinder-31768306-2ec2-4197-9ec5-93c9bab7305c-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Lock "cinder-31768306-2ec2-4197-9ec5-93c9bab7305c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Acquiring lock "cinder-quobyte-31768306-2ec2-4197-9ec5-93c9bab7305c" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Lock "cinder-quobyte-31768306-2ec2-4197-9ec5-93c9bab7305c" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:50 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b80838-e92b-402c-8c55-f86e569db521]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31768306-2ec2-4197-9ec5-93c9bab7305c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:50 devstack sudo[94631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31768306-2ec2-4197-9ec5-93c9bab7305c Sep 04 19:08:50 devstack sudo[94631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:51 devstack sudo[94631]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31768306-2ec2-4197-9ec5-93c9bab7305c" returned: 0 in 0.680s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31768306-2ec2-4197-9ec5-93c9bab7305c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:51 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31768306-2ec2-4197-9ec5-93c9bab7305c Sep 04 19:08:51 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:51 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31768306-2ec2-4197-9ec5-93c9bab7305c" returned: 0 in 0.476s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Lock "cinder-quobyte-31768306-2ec2-4197-9ec5-93c9bab7305c" released by "delete_volume" :: held 1.266s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:52 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Created reservations ['a53e0aa6-2646-428e-9e08-2939e7d8d5af', 'bad9f494-f256-4be9-bd9d-fff42b995d27', '65a3c05c-285b-4dd3-bd2e-87777efe8587', 'f60868c1-9a57-4787-9dcc-d7a7e96cbb31'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:08:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:08:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:08:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:52 devstack sudo[94654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:08:52 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:52 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.373s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:52 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:08:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Deleted volume successfully. Sep 04 19:08:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-efec5497-d8f8-47fb-81f5-acfd6f9a4207 tempest-VolumesTransfersTest-182619330 None] Lock "cinder-31768306-2ec2-4197-9ec5-93c9bab7305c-delete_volume" released by "delete_volume" :: held 2.112s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:53 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=86,cinder:UPDATE=84,cinder:INSERT=21,cinder:DELETE=7 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Flow 'volume_create_manager' (55fce1c8-b48c-410b-89f0-d97d27a78fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9251ff5a-a8be-412a-856c-818758f0e004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9251ff5a-a8be-412a-856c-818758f0e004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-826307559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73526ffeb40547aa9caa82f485c74cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:08:54Z,use_quota=True,user_id='33247e7ee57441e9bed3336048cf66c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df347df-a4a3-4cd1-89e0-b65c5148249c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0df347df-a4a3-4cd1-89e0-b65c5148249c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7d7b67-47c6-43e8-ab61-f889caa26bc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a7d7b67-47c6-43e8-ab61-f889caa26bc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa', 'volume_name': 'volume-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae2c04f-4dfe-4898-9110-87a9d45e4404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae2c04f-4dfe-4898-9110-87a9d45e4404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde7c7ab-b074-4603-9649-8cf18aed8784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:54 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Volume b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa', 'volume_size': 1} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-826307559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73526ffeb40547aa9caa82f485c74cb4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:08:54Z,use_quota=True,user_id='33247e7ee57441e9bed3336048cf66c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Creating volume b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:08:54 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:54 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa 1073741824 Sep 04 19:08:54 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:54 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa 1073741824" returned: 0 in 0.778s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:55 devstack sudo[94713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa Sep 04 19:08:55 devstack sudo[94713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:55 devstack sudo[94713]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa" returned: 0 in 0.321s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:08:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde7c7ab-b074-4603-9649-8cf18aed8784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e489ca9-c12b-444d-8af4-ec91aebb404a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:08:55 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Volume volume-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa (b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa): created successfully Sep 04 19:08:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e489ca9-c12b-444d-8af4-ec91aebb404a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:08:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Flow 'volume_create_manager' (55fce1c8-b48c-410b-89f0-d97d27a78fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:08:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-652c0578-07d7-418f-8232-0af467e11269 tempest-VolumesTransfersTest-1204170846 None] Created volume successfully. Sep 04 19:08:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Acquiring lock "cinder-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Lock "cinder-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Acquiring lock "cinder-quobyte-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:08:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Lock "cinder-quobyte-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:08:56 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a963d0-594d-4e47-95bb-ab75525717b6]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:08:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:56 devstack sudo[94720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa Sep 04 19:08:56 devstack sudo[94720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:56 devstack sudo[94720]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa" returned: 0 in 0.409s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:56 devstack sudo[94725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa Sep 04 19:08:56 devstack sudo[94725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:57 devstack sudo[94725]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa" returned: 0 in 0.311s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Lock "cinder-quobyte-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa" released by "delete_volume" :: held 0.777s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:08:57 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Created reservations ['2c8e509d-1411-46da-b10c-1a8f884e98ad', '85f852d5-91b6-4861-8720-3d03676fab7f', '20263ec9-142e-4253-bcdf-d9a5f29c876e', 'ecd88513-8dcf-43c1-80a8-ebf50501dae2'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:08:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:08:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:08:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:08:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:08:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:08:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:08:57 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:08:57 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:08:57 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Sep 04 19:08:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.383s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:08:57 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:08:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Deleted volume successfully. Sep 04 19:08:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0c7082b-222e-4127-b932-19b50ca2d65c tempest-VolumesTransfersTest-182619330 None] Lock "cinder-b15c9c81-eeae-4f9f-9d1c-77260ae7d1fa-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:09:07 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:INSERT=2 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:09:07 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=29,cinder:SELECT=14,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Flow 'volume_create_manager' (05fad131-cece-484c-9b4d-a58b34c4d8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570d232a-0604-405e-b859-df4aa139fddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (570d232a-0604-405e-b859-df4aa139fddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1474816002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba08fd80aed44ef798059266e362c259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:17Z,use_quota=True,user_id='a23748e915764b678671d71060fb585b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d215af80-f2c5-434b-80ab-41003ad5c4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d215af80-f2c5-434b-80ab-41003ad5c4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b037b724-9b8c-49d6-b77b-0eeb14cc0ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b037b724-9b8c-49d6-b77b-0eeb14cc0ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad', 'volume_name': 'volume-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43aeadf-5b0b-47f2-b0c3-5fe28c941cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a43aeadf-5b0b-47f2-b0c3-5fe28c941cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e99e69e-2db7-4822-af07-85eab16e6431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:17 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Volume 8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad', 'volume_size': 1} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1474816002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba08fd80aed44ef798059266e362c259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:17Z,use_quota=True,user_id='a23748e915764b678671d71060fb585b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Creating volume 8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:09:17 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:09:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:17 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad 1073741824 Sep 04 19:09:17 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:18 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad 1073741824" returned: 0 in 0.713s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:18 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad Sep 04 19:09:18 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:18 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad" returned: 0 in 0.467s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e99e69e-2db7-4822-af07-85eab16e6431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b4a9b2-f847-411b-aaa1-8f732043aed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Flow 'volume_create_manager' (941929bf-b4b1-4a1b-b0e6-2d314d02f6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e727a2db-9d07-4e37-88ea-50f005a2ae27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:18 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Volume volume-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad (8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad): created successfully Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b4a9b2-f847-411b-aaa1-8f732043aed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Flow 'volume_create_manager' (05fad131-cece-484c-9b4d-a58b34c4d8d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e727a2db-9d07-4e37-88ea-50f005a2ae27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2020433091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e87900d-850f-440c-89fe-5ac235332975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddd9ab780044f398b0bb1f911905312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:19Z,use_quota=True,user_id='0ef2e520449049d6941517507ec893f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f566d05-1de2-4059-96fd-70715dc00fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f566d05-1de2-4059-96fd-70715dc00fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ee8bc9-f74f-49c0-88db-666960bd81c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ee8bc9-f74f-49c0-88db-666960bd81c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e87900d-850f-440c-89fe-5ac235332975', 'volume_name': 'volume-9e87900d-850f-440c-89fe-5ac235332975', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5bb470-4adf-46a3-acbb-9813d84d0add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac5bb470-4adf-46a3-acbb-9813d84d0add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259dbd06-cdbd-40a1-ba19-f100c478ad5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:18 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Volume 9e87900d-850f-440c-89fe-5ac235332975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e87900d-850f-440c-89fe-5ac235332975', 'volume_size': 1} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2020433091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e87900d-850f-440c-89fe-5ac235332975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cddd9ab780044f398b0bb1f911905312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:19Z,use_quota=True,user_id='0ef2e520449049d6941517507ec893f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Creating volume 9e87900d-850f-440c-89fe-5ac235332975 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:09:18 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:09:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e87900d-850f-440c-89fe-5ac235332975 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-46af87ac-0889-4f7d-aa51-f66143b22387 tempest-VolumesTransfersV357Test-253719745 None] Created volume successfully. Sep 04 19:09:18 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e87900d-850f-440c-89fe-5ac235332975 1073741824 Sep 04 19:09:18 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:19 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e87900d-850f-440c-89fe-5ac235332975 1073741824" returned: 0 in 0.644s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e87900d-850f-440c-89fe-5ac235332975 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:19 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e87900d-850f-440c-89fe-5ac235332975 Sep 04 19:09:19 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:20 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e87900d-850f-440c-89fe-5ac235332975" returned: 0 in 0.481s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:09:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259dbd06-cdbd-40a1-ba19-f100c478ad5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e87900d-850f-440c-89fe-5ac235332975', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832b2cbd-6c20-47f2-8ec2-cdac574cbb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:20 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Volume volume-9e87900d-850f-440c-89fe-5ac235332975 (9e87900d-850f-440c-89fe-5ac235332975): created successfully Sep 04 19:09:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (832b2cbd-6c20-47f2-8ec2-cdac574cbb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Flow 'volume_create_manager' (941929bf-b4b1-4a1b-b0e6-2d314d02f6bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:20 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7f2f4c8d-d938-4ff6-a75a-25b890a1fe41 tempest-ServerRescueNegativeTestJSON-380654877 None] Created volume successfully. Sep 04 19:09:20 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8445fbb8-d0c5-49bb-ab4d-4c8780ae234d tempest-VolumesTransfersV357Test-1770992106 None] Transfer volume completed successfully. Sep 04 19:09:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Acquiring lock "cinder-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:09:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Lock "cinder-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:09:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Acquiring lock "cinder-quobyte-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:09:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Lock "cinder-quobyte-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad" acquired by "delete_volume" :: waited 0.060s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:09:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9adb65-7e21-4018-be80-39ebfd77f936]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:09:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:21 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad Sep 04 19:09:21 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:22 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad" returned: 0 in 0.681s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:22 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad Sep 04 19:09:22 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:22 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad" returned: 0 in 0.512s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Lock "cinder-quobyte-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad" released by "delete_volume" :: held 1.266s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:09:22 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Created reservations ['7d3969a1-54ba-4dcc-99db-ef9fc4ce89c1', '283e9437-54b1-41fb-9928-8b0c674c2b25', '1bbf92db-d945-438e-aff9-c02d9cbaaf24', 'd31570d5-f0c9-4510-88dd-80ccbcac026b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:09:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:09:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:09:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:22 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:09:22 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:23 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.479s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:23 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:09:23 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Deleted volume successfully. Sep 04 19:09:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-adbc0404-c7ee-45ca-ad1a-5436ce7c3ffd tempest-VolumesTransfersV357Test-1911000594 None] Lock "cinder-8f70baa5-d2b4-43ac-9e86-f7a3be4f24ad-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Flow 'volume_create_manager' (83e947d2-cc06-4aeb-8572-68242e23e6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef8a810-1553-44f3-9c5f-840e7736a79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aef8a810-1553-44f3-9c5f-840e7736a79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1191469496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691e0bef-f9ac-4891-afe0-8f704abaa52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba08fd80aed44ef798059266e362c259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:24Z,use_quota=True,user_id='a23748e915764b678671d71060fb585b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e7eae5-3abf-4d36-9332-660ab4d3f6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5e7eae5-3abf-4d36-9332-660ab4d3f6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2b7370-5eb4-454a-9f1c-c64e82d1b773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de2b7370-5eb4-454a-9f1c-c64e82d1b773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '691e0bef-f9ac-4891-afe0-8f704abaa52b', 'volume_name': 'volume-691e0bef-f9ac-4891-afe0-8f704abaa52b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4169d496-97e6-4ec0-b246-b09080d69ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4169d496-97e6-4ec0-b246-b09080d69ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7b4e28-f39f-45fc-93ea-05b180999f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Volume 691e0bef-f9ac-4891-afe0-8f704abaa52b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-691e0bef-f9ac-4891-afe0-8f704abaa52b', 'volume_size': 1} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1191469496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=691e0bef-f9ac-4891-afe0-8f704abaa52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba08fd80aed44ef798059266e362c259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:24Z,use_quota=True,user_id='a23748e915764b678671d71060fb585b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Creating volume 691e0bef-f9ac-4891-afe0-8f704abaa52b {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:09:24 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:09:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-691e0bef-f9ac-4891-afe0-8f704abaa52b 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:24 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-691e0bef-f9ac-4891-afe0-8f704abaa52b 1073741824 Sep 04 19:09:24 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:25 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-691e0bef-f9ac-4891-afe0-8f704abaa52b 1073741824" returned: 0 in 0.655s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-691e0bef-f9ac-4891-afe0-8f704abaa52b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:25 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-691e0bef-f9ac-4891-afe0-8f704abaa52b Sep 04 19:09:25 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:25 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-691e0bef-f9ac-4891-afe0-8f704abaa52b" returned: 0 in 0.341s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:09:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b7b4e28-f39f-45fc-93ea-05b180999f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-691e0bef-f9ac-4891-afe0-8f704abaa52b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b8fff1-d735-4687-b174-67aacf189cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:25 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Volume volume-691e0bef-f9ac-4891-afe0-8f704abaa52b (691e0bef-f9ac-4891-afe0-8f704abaa52b): created successfully Sep 04 19:09:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31b8fff1-d735-4687-b174-67aacf189cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Flow 'volume_create_manager' (83e947d2-cc06-4aeb-8572-68242e23e6c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-37ca4cb6-3c7e-4aae-8ae4-a55c80b35f15 tempest-VolumesTransfersV357Test-253719745 None] Created volume successfully. Sep 04 19:09:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Acquiring lock "cinder-691e0bef-f9ac-4891-afe0-8f704abaa52b-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:09:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Lock "cinder-691e0bef-f9ac-4891-afe0-8f704abaa52b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:09:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Acquiring lock "cinder-quobyte-691e0bef-f9ac-4891-afe0-8f704abaa52b" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:09:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Lock "cinder-quobyte-691e0bef-f9ac-4891-afe0-8f704abaa52b" acquired by "delete_volume" :: waited 0.039s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:09:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[64f1dd0d-4fe2-4018-9733-22d985019f2e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:09:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-691e0bef-f9ac-4891-afe0-8f704abaa52b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:27 devstack sudo[95197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-691e0bef-f9ac-4891-afe0-8f704abaa52b Sep 04 19:09:27 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:27 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-691e0bef-f9ac-4891-afe0-8f704abaa52b" returned: 0 in 0.383s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-691e0bef-f9ac-4891-afe0-8f704abaa52b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:27 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-691e0bef-f9ac-4891-afe0-8f704abaa52b Sep 04 19:09:27 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:28 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-691e0bef-f9ac-4891-afe0-8f704abaa52b" returned: 0 in 0.295s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Lock "cinder-quobyte-691e0bef-f9ac-4891-afe0-8f704abaa52b" released by "delete_volume" :: held 0.731s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:09:28 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Created reservations ['77b70113-ecaf-486f-8807-feff1edefb59', 'a8abed36-3da6-4370-b266-ab8d09e28449', 'a1be4ca4-cf40-4722-b305-83e5375ff201', '2414c66f-bf3e-4d45-a5b2-b448a9c45793'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:09:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:09:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:09:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:28 devstack sudo[95232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:09:28 devstack sudo[95232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:28 devstack sudo[95232]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.264s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:28 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:09:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Deleted volume successfully. Sep 04 19:09:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6c631830-3043-424a-aadd-10a9c76e3ff9 tempest-VolumesTransfersV357Test-1911000594 None] Lock "cinder-691e0bef-f9ac-4891-afe0-8f704abaa52b-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:09:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Acquiring lock "cinder-9e87900d-850f-440c-89fe-5ac235332975-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:09:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Lock "cinder-9e87900d-850f-440c-89fe-5ac235332975-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:09:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Acquiring lock "cinder-quobyte-9e87900d-850f-440c-89fe-5ac235332975" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:09:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Lock "cinder-quobyte-9e87900d-850f-440c-89fe-5ac235332975" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:09:29 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c305b1-44ea-4773-9abe-76de3bc37ec9]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:09:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e87900d-850f-440c-89fe-5ac235332975 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:29 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e87900d-850f-440c-89fe-5ac235332975 Sep 04 19:09:29 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:30 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e87900d-850f-440c-89fe-5ac235332975" returned: 0 in 0.486s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e87900d-850f-440c-89fe-5ac235332975 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:30 devstack sudo[95242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e87900d-850f-440c-89fe-5ac235332975 Sep 04 19:09:30 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:30 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e87900d-850f-440c-89fe-5ac235332975" returned: 0 in 0.367s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Lock "cinder-quobyte-9e87900d-850f-440c-89fe-5ac235332975" released by "delete_volume" :: held 0.929s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:09:30 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Created reservations ['73811ff1-15bf-480d-9af1-a40fd6968376', '1d884260-e2e6-4b6a-b518-0cb99e89b73f', 'b5b3dae2-2d58-444b-af10-862be916acce', '71e5c581-c3fe-47b5-baa8-31b6926f0908'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:09:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:09:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:09:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:30 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:09:30 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:31 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.490s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:31 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:09:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Deleted volume successfully. Sep 04 19:09:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fda61c65-a0fc-4b43-9747-8c44515f4621 tempest-ServerRescueNegativeTestJSON-380654877 None] Lock "cinder-9e87900d-850f-440c-89fe-5ac235332975-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Flow 'volume_create_manager' (fab54e8d-677b-4092-8f81-575c1ff5a6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3c579a-8497-40fb-9499-ed711b9c3100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3c579a-8497-40fb-9499-ed711b9c3100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-253630721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d579002-78ee-45a9-80a8-45cdd32e4943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07f4875ca3d84a418a6a50d6a6fec994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:38Z,use_quota=True,user_id='da5381e4c08c4da697a6e0fe24399bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3aee668-9ded-468c-afa8-7836ecaff435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3aee668-9ded-468c-afa8-7836ecaff435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff13da1-010b-4e8a-96c1-dd904e9eee1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ff13da1-010b-4e8a-96c1-dd904e9eee1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d579002-78ee-45a9-80a8-45cdd32e4943', 'volume_name': 'volume-7d579002-78ee-45a9-80a8-45cdd32e4943', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c23649-4f3d-4287-8472-c361f75d53b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48c23649-4f3d-4287-8472-c361f75d53b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa3d28e-f368-4993-be89-43691d6a36c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:37 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Volume 7d579002-78ee-45a9-80a8-45cdd32e4943: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d579002-78ee-45a9-80a8-45cdd32e4943', 'volume_size': 1} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-253630721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d579002-78ee-45a9-80a8-45cdd32e4943,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07f4875ca3d84a418a6a50d6a6fec994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:38Z,use_quota=True,user_id='da5381e4c08c4da697a6e0fe24399bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Creating volume 7d579002-78ee-45a9-80a8-45cdd32e4943 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:09:37 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:09:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:37 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 1073741824 Sep 04 19:09:37 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:38 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 1073741824" returned: 0 in 0.433s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:38 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 Sep 04 19:09:38 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:38 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943" returned: 0 in 0.244s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:09:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa3d28e-f368-4993-be89-43691d6a36c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d579002-78ee-45a9-80a8-45cdd32e4943', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab420a86-882a-458d-9d6a-23ce4ae45d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:38 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Volume volume-7d579002-78ee-45a9-80a8-45cdd32e4943 (7d579002-78ee-45a9-80a8-45cdd32e4943): created successfully Sep 04 19:09:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab420a86-882a-458d-9d6a-23ce4ae45d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Flow 'volume_create_manager' (fab54e8d-677b-4092-8f81-575c1ff5a6ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-603b290d-f7fc-4051-8764-f7cff16caf83 tempest-VolumesCloneTest-232965638 None] Created volume successfully. Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Flow 'volume_create_manager' (63fa9ba8-deb2-4adf-81bd-e40836e9e46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1a326a-e9da-4d44-852a-481da59f501a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d1a326a-e9da-4d44-852a-481da59f501a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1500035302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=768dd06c-56b6-4508-b716-5f91e9993f52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='07f4875ca3d84a418a6a50d6a6fec994',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=7d579002-78ee-45a9-80a8-45cdd32e4943,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:39Z,use_quota=True,user_id='da5381e4c08c4da697a6e0fe24399bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35efc79-f387-4e8a-8a2c-e02ea258e637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35efc79-f387-4e8a-8a2c-e02ea258e637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a2cf27-4346-49aa-8368-efd889c03129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02a2cf27-4346-49aa-8368-efd889c03129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '768dd06c-56b6-4508-b716-5f91e9993f52', 'volume_name': 'volume-768dd06c-56b6-4508-b716-5f91e9993f52', 'volume_size': 2, 'source_volid': '7d579002-78ee-45a9-80a8-45cdd32e4943', 'source_volstatus': 'available'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1118fd13-679f-4cd6-8af7-70df5b309614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1118fd13-679f-4cd6-8af7-70df5b309614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568d13fe-5369-41ae-a459-10352a62773c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:39 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Volume 768dd06c-56b6-4508-b716-5f91e9993f52: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-768dd06c-56b6-4508-b716-5f91e9993f52', 'volume_size': 2, 'source_volid': '7d579002-78ee-45a9-80a8-45cdd32e4943', 'source_volstatus': 'available'} Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:39 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Cloning volume 7d579002-78ee-45a9-80a8-45cdd32e4943 to volume 768dd06c-56b6-4508-b716-5f91e9993f52 Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Creating offline snapshot 979d37d3-20c5-4d87-8383-b1f1ebd084cf of volume 7d579002-78ee-45a9-80a8-45cdd32e4943 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ce9c37-b750-493d-bde7-d2d8fba4977d]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:39 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 Sep 04 19:09:39 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:39 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943" returned: 0 in 0.399s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:39 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf 1G Sep 04 19:09:39 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:40 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf 1G" returned: 0 in 0.415s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d579002-78ee-45a9-80a8-45cdd32e4943 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:40 devstack sudo[95324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d579002-78ee-45a9-80a8-45cdd32e4943 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf Sep 04 19:09:40 devstack sudo[95324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:40 devstack sudo[95324]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d579002-78ee-45a9-80a8-45cdd32e4943 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf" returned: 0 in 0.312s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:40 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf is being set with open permissions: ugo+rw Sep 04 19:09:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:40 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf Sep 04 19:09:40 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:40 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf" returned: 0 in 0.258s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:40 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.info Sep 04 19:09:40 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:41 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.info" returned: 0 in 0.262s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:41 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.info is being set with open permissions: ugo+rw Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:41 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.info Sep 04 19:09:41 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:41 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.info" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Acquiring lock "cinder-quobyte-768dd06c-56b6-4508-b716-5f91e9993f52" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Lock "cinder-quobyte-768dd06c-56b6-4508-b716-5f91e9993f52" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] snapshot: 979d37d3-20c5-4d87-8383-b1f1ebd084cf, volume: 768dd06c-56b6-4508-b716-5f91e9993f52, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[68123177-c2ba-40ce-b9f8-e4fc12854d87]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:41 devstack sudo[95341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf Sep 04 19:09:41 devstack sudo[95341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:41 devstack sudo[95341]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf" returned: 0 in 0.366s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d579002-78ee-45a9-80a8-45cdd32e4943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e96dfb-050a-49fa-b5d0-27c70d1e979e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:09:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:41 devstack sudo[95346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 Sep 04 19:09:41 devstack sudo[95346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:42 devstack sudo[95346]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943" returned: 0 in 0.360s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 19:09:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 19:09:42 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Path /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-768dd06c-56b6-4508-b716-5f91e9993f52 not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 19:09:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-768dd06c-56b6-4508-b716-5f91e9993f52 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:42 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-768dd06c-56b6-4508-b716-5f91e9993f52 Sep 04 19:09:42 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:09:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:09:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:09:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:45 devstack sudo[95366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:09:45 devstack sudo[95366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:46 devstack sudo[95366]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.882s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Flow 'volume_create_manager' (a75f54b1-cbb7-47eb-86d6-20bd2fb308b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9875ab5b-55e6-4231-9a0e-4abb1fc9d0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9875ab5b-55e6-4231-9a0e-4abb1fc9d0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1177872225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ddce13-50e7-4acb-a90a-583a84e4e998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba584b9bdeb49f0871854651f48e3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:47Z,use_quota=True,user_id='20e8ec456c23446787349e82f7c34b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cebbad1-2f12-434c-b2b6-3f609f26ec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cebbad1-2f12-434c-b2b6-3f609f26ec1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea06069d-37e1-4b49-9504-c398f70c8f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea06069d-37e1-4b49-9504-c398f70c8f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ddce13-50e7-4acb-a90a-583a84e4e998', 'volume_name': 'volume-b1ddce13-50e7-4acb-a90a-583a84e4e998', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bed9b86-b5dc-48b3-ad80-61119598f32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bed9b86-b5dc-48b3-ad80-61119598f32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25733c51-7b49-4c6f-8cb1-ba93edf3c442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:46 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Volume b1ddce13-50e7-4acb-a90a-583a84e4e998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ddce13-50e7-4acb-a90a-583a84e4e998', 'volume_size': 1} Sep 04 19:09:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:47 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-768dd06c-56b6-4508-b716-5f91e9993f52" returned: 0 in 5.482s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:47 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943, size 1024.00 MB, duration 5.48 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-768dd06c-56b6-4508-b716-5f91e9993f52 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:09:47 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Converted 1024.00 MB image at 186.78 MB/s Sep 04 19:09:47 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-768dd06c-56b6-4508-b716-5f91e9993f52 is being set with open permissions: ugo+rw Sep 04 19:09:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-768dd06c-56b6-4508-b716-5f91e9993f52 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:47 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-768dd06c-56b6-4508-b716-5f91e9993f52 Sep 04 19:09:47 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:47 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-768dd06c-56b6-4508-b716-5f91e9993f52" returned: 0 in 0.290s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Lock "cinder-quobyte-768dd06c-56b6-4508-b716-5f91e9993f52" released by "_copy_volume_from_snapshot" :: held 6.567s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:09:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Acquiring lock "cinder-quobyte-979d37d3-20c5-4d87-8383-b1f1ebd084cf" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:09:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Lock "cinder-quobyte-979d37d3-20c5-4d87-8383-b1f1ebd084cf" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:09:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Deleting offline snapshot 979d37d3-20c5-4d87-8383-b1f1ebd084cf of volume 7d579002-78ee-45a9-80a8-45cdd32e4943 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:09:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] snapshot_file for this snap is: volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:09:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3374fdb9-1e5c-4403-8011-87163e15ef2a]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:09:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:48 devstack sudo[95387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf Sep 04 19:09:48 devstack sudo[95387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:48 devstack sudo[95387]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf" returned: 0 in 0.407s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d579002-78ee-45a9-80a8-45cdd32e4943(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:09:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[20fb326c-044d-47fb-a348-602bed337fa4]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:09:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:48 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 Sep 04 19:09:48 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:48 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943" returned: 0 in 0.540s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:49 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf Sep 04 19:09:49 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:49 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf" returned: 0 in 0.415s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:49 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf Sep 04 19:09:49 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:49 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943.979d37d3-20c5-4d87-8383-b1f1ebd084cf" returned: 0 in 0.304s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Lock "cinder-quobyte-979d37d3-20c5-4d87-8383-b1f1ebd084cf" released by "_delete_snapshot" :: held 1.801s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.482s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.852s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1177872225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ddce13-50e7-4acb-a90a-583a84e4e998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba584b9bdeb49f0871854651f48e3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:47Z,use_quota=True,user_id='20e8ec456c23446787349e82f7c34b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Creating volume b1ddce13-50e7-4acb-a90a-583a84e4e998 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:09:49 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ddce13-50e7-4acb-a90a-583a84e4e998 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:49 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ddce13-50e7-4acb-a90a-583a84e4e998 1073741824 Sep 04 19:09:49 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (568d13fe-5369-41ae-a459-10352a62773c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-768dd06c-56b6-4508-b716-5f91e9993f52', 'volume_size': 2, 'source_volid': '7d579002-78ee-45a9-80a8-45cdd32e4943', 'source_volstatus': 'available'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5b5143-4c51-4a18-91ed-3c4ca78624bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:49 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Volume volume-768dd06c-56b6-4508-b716-5f91e9993f52 (768dd06c-56b6-4508-b716-5f91e9993f52): created successfully Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c5b5143-4c51-4a18-91ed-3c4ca78624bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Flow 'volume_create_manager' (63fa9ba8-deb2-4adf-81bd-e40836e9e46d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0a6d43e6-483f-4416-8f87-d82af9c23027 tempest-VolumesCloneTest-232965638 None] Created volume successfully. Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Flow 'volume_create_manager' (68be8721-18e4-4ddb-abc8-3f976dbf2140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db10e98-d8a3-4c25-92a9-c28febf98252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0db10e98-d8a3-4c25-92a9-c28febf98252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1894055440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49bdc487-9e66-42ca-8d16-9cd8f598a8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a13e1b4d78647559438efc43d7815c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:50Z,use_quota=True,user_id='0374ed63eb9c4ac1bfecef338246062f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6bd108-9f92-412c-9714-5f29f121aa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca6bd108-9f92-412c-9714-5f29f121aa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f36d134-7fb4-447f-8ab1-d4b9fe68e7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f36d134-7fb4-447f-8ab1-d4b9fe68e7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49bdc487-9e66-42ca-8d16-9cd8f598a8df', 'volume_name': 'volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516c85d2-7b4a-4db1-8204-b787699303a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (516c85d2-7b4a-4db1-8204-b787699303a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d80dc3a-f7ec-4fb5-b675-941aabdaa3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:50 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Volume 49bdc487-9e66-42ca-8d16-9cd8f598a8df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df', 'volume_size': 1} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:50 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ddce13-50e7-4acb-a90a-583a84e4e998 1073741824" returned: 0 in 0.546s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ddce13-50e7-4acb-a90a-583a84e4e998 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:50 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ddce13-50e7-4acb-a90a-583a84e4e998 Sep 04 19:09:50 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Acquiring lock "cinder-768dd06c-56b6-4508-b716-5f91e9993f52-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Lock "cinder-768dd06c-56b6-4508-b716-5f91e9993f52-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Acquiring lock "cinder-quobyte-768dd06c-56b6-4508-b716-5f91e9993f52" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Lock "cinder-quobyte-768dd06c-56b6-4508-b716-5f91e9993f52" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[84668c28-88c1-41db-a85c-8f0211770e39]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-768dd06c-56b6-4508-b716-5f91e9993f52 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:50 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ddce13-50e7-4acb-a90a-583a84e4e998" returned: 0 in 0.325s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.607s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1894055440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49bdc487-9e66-42ca-8d16-9cd8f598a8df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a13e1b4d78647559438efc43d7815c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:50Z,use_quota=True,user_id='0374ed63eb9c4ac1bfecef338246062f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Creating volume 49bdc487-9e66-42ca-8d16-9cd8f598a8df {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:09:50 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25733c51-7b49-4c6f-8cb1-ba93edf3c442) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ddce13-50e7-4acb-a90a-583a84e4e998', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73f9217-6315-46b7-80e4-779c5c7461aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:50 devstack sudo[95424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df 1073741824 Sep 04 19:09:50 devstack sudo[95424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:50 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Volume volume-b1ddce13-50e7-4acb-a90a-583a84e4e998 (b1ddce13-50e7-4acb-a90a-583a84e4e998): created successfully Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b73f9217-6315-46b7-80e4-779c5c7461aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Flow 'volume_create_manager' (a75f54b1-cbb7-47eb-86d6-20bd2fb308b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:50 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-768dd06c-56b6-4508-b716-5f91e9993f52 Sep 04 19:09:50 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:50 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-76db11b5-1eab-42d1-8cd1-d44cb4f1618e tempest-AttachVolumeTestJSON-1764077708 None] Created volume successfully. Sep 04 19:09:51 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-768dd06c-56b6-4508-b716-5f91e9993f52" returned: 0 in 0.446s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-768dd06c-56b6-4508-b716-5f91e9993f52 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:51 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-768dd06c-56b6-4508-b716-5f91e9993f52 Sep 04 19:09:51 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:51 devstack sudo[95424]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df 1073741824" returned: 0 in 0.529s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:51 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df Sep 04 19:09:51 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:51 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-768dd06c-56b6-4508-b716-5f91e9993f52" returned: 0 in 0.273s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Lock "cinder-quobyte-768dd06c-56b6-4508-b716-5f91e9993f52" released by "delete_volume" :: held 0.771s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Created reservations ['d417b940-cd6e-42e9-aa62-7395721242b6', '880e5e91-8c97-437f-bfd4-6e4e3b68e014', '3c9d92c3-2b90-45a6-a903-b6f330bfeacd', '7a00d99e-50ac-42dc-8f0c-57cb097ff7c3'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:51 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df" returned: 0 in 0.280s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:51 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:09:51 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d80dc3a-f7ec-4fb5-b675-941aabdaa3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfcb0c6-7d7c-4b14-aa2b-ea3b5e4bb0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:51 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Volume volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df (49bdc487-9e66-42ca-8d16-9cd8f598a8df): created successfully Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cfcb0c6-7d7c-4b14-aa2b-ea3b5e4bb0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Flow 'volume_create_manager' (68be8721-18e4-4ddb-abc8-3f976dbf2140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-89395387-5185-4206-a965-8921704cf476 tempest-AttachVolumeNegativeTest-23207716 None] Created volume successfully. Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Acquiring lock "cinder-7d579002-78ee-45a9-80a8-45cdd32e4943-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:09:51 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.299s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:09:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Deleted volume successfully. Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Lock "cinder-7d579002-78ee-45a9-80a8-45cdd32e4943-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:09:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2dd3e5f7-1326-4b49-ad09-fd5706137930 tempest-VolumesCloneTest-232965638 None] Lock "cinder-768dd06c-56b6-4508-b716-5f91e9993f52-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:09:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Acquiring lock "cinder-quobyte-7d579002-78ee-45a9-80a8-45cdd32e4943" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:09:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Lock "cinder-quobyte-7d579002-78ee-45a9-80a8-45cdd32e4943" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:09:52 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[801352d5-fb30-4b34-bb1f-079d72dcffea]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:09:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:52 devstack sudo[95447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 Sep 04 19:09:52 devstack sudo[95447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:52 devstack sudo[95447]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943" returned: 0 in 0.563s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:52 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943 Sep 04 19:09:52 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:53 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7d579002-78ee-45a9-80a8-45cdd32e4943" returned: 0 in 0.405s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Lock "cinder-quobyte-7d579002-78ee-45a9-80a8-45cdd32e4943" released by "delete_volume" :: held 1.072s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-7ccf7b3e-66dc-4a82-a96e-7a6739e6e4ba req-cf29a49f-524c-4fee-aee0-4e897d99639b tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-7ccf7b3e-66dc-4a82-a96e-7a6739e6e4ba req-cf29a49f-524c-4fee-aee0-4e897d99639b tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-7ccf7b3e-66dc-4a82-a96e-7a6739e6e4ba req-cf29a49f-524c-4fee-aee0-4e897d99639b tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Created reservations ['85802ef7-28b8-48cc-8b1f-2cb3510f0465', '57cbb267-cc37-481c-9e51-0db9df1876ad', '81ff65f9-144e-4e53-9cfc-2411d0227545', 'baa4567f-b311-4438-be39-8e66ebbda23a'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-7ccf7b3e-66dc-4a82-a96e-7a6739e6e4ba req-cf29a49f-524c-4fee-aee0-4e897d99639b tempest-AttachVolumeTestJSON-1764077708 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-b1ddce13-50e7-4acb-a90a-583a84e4e998', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef266d19-caf8-4c6a-8a36-3a592fa56754', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:09:53 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-7ccf7b3e-66dc-4a82-a96e-7a6739e6e4ba req-cf29a49f-524c-4fee-aee0-4e897d99639b tempest-AttachVolumeTestJSON-1764077708 None] attachment_update completed successfully. Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:53 devstack sudo[95478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:09:53 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-1eb3cfec-8b9f-41fd-981d-3613e4f5bb40 req-835c5928-c6c5-4876-aeec-683b011e8636 tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-1eb3cfec-8b9f-41fd-981d-3613e4f5bb40 req-835c5928-c6c5-4876-aeec-683b011e8636 tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-1eb3cfec-8b9f-41fd-981d-3613e4f5bb40 req-835c5928-c6c5-4876-aeec-683b011e8636 tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-1eb3cfec-8b9f-41fd-981d-3613e4f5bb40 req-835c5928-c6c5-4876-aeec-683b011e8636 tempest-AttachVolumeNegativeTest-23207716 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea5916e7-e2c2-4bb2-9747-bdecd834fbe7', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:09:53 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-1eb3cfec-8b9f-41fd-981d-3613e4f5bb40 req-835c5928-c6c5-4876-aeec-683b011e8636 tempest-AttachVolumeNegativeTest-23207716 None] attachment_update completed successfully. Sep 04 19:09:53 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.356s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:09:53 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Deleted volume successfully. Sep 04 19:09:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c8079065-0a4c-4013-8e69-581203175a66 tempest-VolumesCloneTest-232965638 None] Lock "cinder-7d579002-78ee-45a9-80a8-45cdd32e4943-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:09:55 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:09:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Flow 'volume_create_manager' (2b2a3762-3025-4940-80f7-5b9d1dc9b8f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4660c36-9c60-4c6a-b946-aa605532f762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4660c36-9c60-4c6a-b946-aa605532f762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1039088796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5944fc21-0575-4b28-a936-4018af34df93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba584b9bdeb49f0871854651f48e3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:56Z,use_quota=True,user_id='20e8ec456c23446787349e82f7c34b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da6c353-af63-49c3-b89b-13d8fc951483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da6c353-af63-49c3-b89b-13d8fc951483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (931f61c8-d1b7-4fec-a65a-20f2a96be3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (931f61c8-d1b7-4fec-a65a-20f2a96be3e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5944fc21-0575-4b28-a936-4018af34df93', 'volume_name': 'volume-5944fc21-0575-4b28-a936-4018af34df93', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca8fedd-b817-4d27-8011-12c3985fa15b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ca8fedd-b817-4d27-8011-12c3985fa15b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606bc640-6b88-4ea6-a581-8be1ece1c5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:56 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Volume 5944fc21-0575-4b28-a936-4018af34df93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5944fc21-0575-4b28-a936-4018af34df93', 'volume_size': 1} Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1039088796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5944fc21-0575-4b28-a936-4018af34df93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cba584b9bdeb49f0871854651f48e3d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:56Z,use_quota=True,user_id='20e8ec456c23446787349e82f7c34b18',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Creating volume 5944fc21-0575-4b28-a936-4018af34df93 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:09:56 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5944fc21-0575-4b28-a936-4018af34df93 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:56 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5944fc21-0575-4b28-a936-4018af34df93 1073741824 Sep 04 19:09:56 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:56 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:56 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-72c16606-53a0-4d38-ad24-83caa362299d req-fc2d8b56-939a-426e-9ff5-6e3bc2f4acc2 tempest-AttachVolumeNegativeTest-23207716 None] Terminate volume connection completed successfully. Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-72c16606-53a0-4d38-ad24-83caa362299d req-fc2d8b56-939a-426e-9ff5-6e3bc2f4acc2 tempest-AttachVolumeNegativeTest-23207716 None] Deleting attachment ea5916e7-e2c2-4bb2-9747-bdecd834fbe7. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5944fc21-0575-4b28-a936-4018af34df93 1073741824" returned: 0 in 0.623s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5944fc21-0575-4b28-a936-4018af34df93 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:56 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5944fc21-0575-4b28-a936-4018af34df93 Sep 04 19:09:56 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:57 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5944fc21-0575-4b28-a936-4018af34df93" returned: 0 in 0.338s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:09:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606bc640-6b88-4ea6-a581-8be1ece1c5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5944fc21-0575-4b28-a936-4018af34df93', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbbf25a-5fa5-4f0b-a9f5-12dcb2fd4820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:57 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Volume volume-5944fc21-0575-4b28-a936-4018af34df93 (5944fc21-0575-4b28-a936-4018af34df93): created successfully Sep 04 19:09:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbbf25a-5fa5-4f0b-a9f5-12dcb2fd4820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Flow 'volume_create_manager' (2b2a3762-3025-4940-80f7-5b9d1dc9b8f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-268d80ea-2540-4869-87cf-8e7f861ca466 tempest-AttachVolumeTestJSON-1764077708 None] Created volume successfully. Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Flow 'volume_create_manager' (75e961b9-0717-450d-b493-63b578d56302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0109efa9-9a9e-4406-aa47-c240b9defa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0109efa9-9a9e-4406-aa47-c240b9defa3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-853352484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a5dd46-62d4-4f74-9614-4f86772bed08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa4cf81a3e5a4d9eab09fcce42e2184c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:58Z,use_quota=True,user_id='bc98a2a0f5ef4adba231800191923cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e7ba74-0381-4e4f-980b-87e5d67e078e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7e7ba74-0381-4e4f-980b-87e5d67e078e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff3e702-18d1-45a8-a48f-33d981c6adb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ff3e702-18d1-45a8-a48f-33d981c6adb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94a5dd46-62d4-4f74-9614-4f86772bed08', 'volume_name': 'volume-94a5dd46-62d4-4f74-9614-4f86772bed08', 'volume_size': 2}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed7439e-fe17-467b-8ef0-253b3feeb5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed7439e-fe17-467b-8ef0-253b3feeb5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee6d8f7-181d-4eb1-af66-4fbf0a6e477f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:58 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Volume 94a5dd46-62d4-4f74-9614-4f86772bed08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94a5dd46-62d4-4f74-9614-4f86772bed08', 'volume_size': 2} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:09:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-853352484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94a5dd46-62d4-4f74-9614-4f86772bed08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa4cf81a3e5a4d9eab09fcce42e2184c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:09:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:09:58Z,use_quota=True,user_id='bc98a2a0f5ef4adba231800191923cf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Creating volume 94a5dd46-62d4-4f74-9614-4f86772bed08 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:09:58 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:09:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94a5dd46-62d4-4f74-9614-4f86772bed08 2147483648 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:58 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94a5dd46-62d4-4f74-9614-4f86772bed08 2147483648 Sep 04 19:09:58 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-4ad5b26e-1504-4500-8763-8577bfc105ee req-51d8d333-3301-4b51-8c60-e100ff544485 tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:09:59 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94a5dd46-62d4-4f74-9614-4f86772bed08 2147483648" returned: 0 in 0.813s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94a5dd46-62d4-4f74-9614-4f86772bed08 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:09:59 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94a5dd46-62d4-4f74-9614-4f86772bed08 Sep 04 19:09:59 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:09:59 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Sep 04 19:09:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94a5dd46-62d4-4f74-9614-4f86772bed08" returned: 0 in 0.267s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:09:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:09:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-4ad5b26e-1504-4500-8763-8577bfc105ee req-51d8d333-3301-4b51-8c60-e100ff544485 tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.379s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:09:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-4ad5b26e-1504-4500-8763-8577bfc105ee req-51d8d333-3301-4b51-8c60-e100ff544485 tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:09:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ee6d8f7-181d-4eb1-af66-4fbf0a6e477f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94a5dd46-62d4-4f74-9614-4f86772bed08', 'volume_size': 2}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8296616-1dfd-48dc-b968-b4e9190351de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:09:59 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Volume volume-94a5dd46-62d4-4f74-9614-4f86772bed08 (94a5dd46-62d4-4f74-9614-4f86772bed08): created successfully Sep 04 19:09:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8296616-1dfd-48dc-b968-b4e9190351de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:09:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Flow 'volume_create_manager' (75e961b9-0717-450d-b493-63b578d56302) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:09:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8387f478-bac5-48fa-9035-c2bf4706cdc5 tempest-VolumesCloneNegativeTest-1024445429 None] Created volume successfully. Sep 04 19:09:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-4ad5b26e-1504-4500-8763-8577bfc105ee req-51d8d333-3301-4b51-8c60-e100ff544485 tempest-AttachVolumeTestJSON-1764077708 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-5944fc21-0575-4b28-a936-4018af34df93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3da4bbca-6c77-4abe-8186-c1385773fbd3', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:09:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-4ad5b26e-1504-4500-8763-8577bfc105ee req-51d8d333-3301-4b51-8c60-e100ff544485 tempest-AttachVolumeTestJSON-1764077708 None] attachment_update completed successfully. Sep 04 19:10:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Acquiring lock "cinder-94a5dd46-62d4-4f74-9614-4f86772bed08-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Lock "cinder-94a5dd46-62d4-4f74-9614-4f86772bed08-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Acquiring lock "cinder-quobyte-94a5dd46-62d4-4f74-9614-4f86772bed08" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Lock "cinder-quobyte-94a5dd46-62d4-4f74-9614-4f86772bed08" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:00 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[327fb03b-8023-41ac-b8f2-0fdefa8387ec]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94a5dd46-62d4-4f74-9614-4f86772bed08 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:00 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94a5dd46-62d4-4f74-9614-4f86772bed08 Sep 04 19:10:00 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:01 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94a5dd46-62d4-4f74-9614-4f86772bed08" returned: 0 in 0.583s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94a5dd46-62d4-4f74-9614-4f86772bed08 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:01 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94a5dd46-62d4-4f74-9614-4f86772bed08 Sep 04 19:10:01 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:01 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94a5dd46-62d4-4f74-9614-4f86772bed08" returned: 0 in 0.407s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Lock "cinder-quobyte-94a5dd46-62d4-4f74-9614-4f86772bed08" released by "delete_volume" :: held 1.044s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:01 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Created reservations ['11a2fb22-2187-48c5-ad55-238a7dfde3ca', '132efdb7-c341-40cb-9cf4-6ef9fff987d4', 'b0e82e45-eb63-420e-bdce-fa4968e77b2b', 'cda6cfcd-f181-4968-839d-00ef4bde0a70'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:01 devstack sudo[95937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:01 devstack sudo[95937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:02 devstack sudo[95937]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.467s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:02 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:02 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Deleted volume successfully. Sep 04 19:10:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-871caedc-5a6f-4fe5-a183-88f17e4df034 tempest-VolumesCloneNegativeTest-1024445429 None] Lock "cinder-94a5dd46-62d4-4f74-9614-4f86772bed08-delete_volume" released by "delete_volume" :: held 1.824s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:02 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-214081e9-1a3d-4a49-8f56-941087127169 req-3c3cb1ec-b18f-4097-9620-fc48fc2f6d04 tempest-AttachVolumeTestJSON-1764077708 None] Terminate volume connection completed successfully. Sep 04 19:10:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-214081e9-1a3d-4a49-8f56-941087127169 req-3c3cb1ec-b18f-4097-9620-fc48fc2f6d04 tempest-AttachVolumeTestJSON-1764077708 None] Deleting attachment ef266d19-caf8-4c6a-8a36-3a592fa56754. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:10:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "cinder-49bdc487-9e66-42ca-8d16-9cd8f598a8df-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Lock "cinder-49bdc487-9e66-42ca-8d16-9cd8f598a8df-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "cinder-quobyte-49bdc487-9e66-42ca-8d16-9cd8f598a8df" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Lock "cinder-quobyte-49bdc487-9e66-42ca-8d16-9cd8f598a8df" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:03 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2977e703-eef2-4543-a519-65d088887436]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:04 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df Sep 04 19:10:04 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:04 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-c3f0ee00-9722-4f08-ad75-b0c46064dbc4 req-e7fbfae0-a342-4a25-9756-084784a763b1 tempest-AttachVolumeTestJSON-1764077708 None] Terminate volume connection completed successfully. Sep 04 19:10:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-c3f0ee00-9722-4f08-ad75-b0c46064dbc4 req-e7fbfae0-a342-4a25-9756-084784a763b1 tempest-AttachVolumeTestJSON-1764077708 None] Deleting attachment 3da4bbca-6c77-4abe-8186-c1385773fbd3. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:10:04 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df" returned: 0 in 0.516s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:04 devstack sudo[95976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df Sep 04 19:10:04 devstack sudo[95976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:04 devstack sudo[95976]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-49bdc487-9e66-42ca-8d16-9cd8f598a8df" returned: 0 in 0.313s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Lock "cinder-quobyte-49bdc487-9e66-42ca-8d16-9cd8f598a8df" released by "delete_volume" :: held 0.897s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:04 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Created reservations ['1aa08c29-a846-4af0-b19a-5317ba354ef3', 'e7b8a767-4c4e-4c8b-b28b-a876e2857821', 'f687d383-3696-432b-a1cf-91977c708eb2', '1af6795c-c2b1-4427-8ce6-5b8fc6455f25'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:05 devstack sudo[95982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:05 devstack sudo[95982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "cinder-616c3adf-018a-4ea5-adfe-206cf9de9425-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Lock "cinder-616c3adf-018a-4ea5-adfe-206cf9de9425-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "cinder-quobyte-616c3adf-018a-4ea5-adfe-206cf9de9425" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Lock "cinder-quobyte-616c3adf-018a-4ea5-adfe-206cf9de9425" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:05 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[460a02e4-2efd-4074-8aee-98cb4f8f615b]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-616c3adf-018a-4ea5-adfe-206cf9de9425 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:05 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-616c3adf-018a-4ea5-adfe-206cf9de9425 Sep 04 19:10:05 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:05 devstack sudo[95982]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.507s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:05 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:05 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Deleted volume successfully. Sep 04 19:10:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b9b4ec7e-3f9d-4cc8-8538-a6bae206f74a tempest-AttachVolumeNegativeTest-23207716 None] Lock "cinder-49bdc487-9e66-42ca-8d16-9cd8f598a8df-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:05 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-616c3adf-018a-4ea5-adfe-206cf9de9425" returned: 0 in 0.510s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-616c3adf-018a-4ea5-adfe-206cf9de9425 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:05 devstack sudo[95991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-616c3adf-018a-4ea5-adfe-206cf9de9425 Sep 04 19:10:05 devstack sudo[95991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:06 devstack sudo[95991]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-616c3adf-018a-4ea5-adfe-206cf9de9425" returned: 0 in 0.545s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Lock "cinder-quobyte-616c3adf-018a-4ea5-adfe-206cf9de9425" released by "delete_volume" :: held 1.115s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:06 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Created reservations ['30c28ee1-1f10-4d13-8d50-c93c12c1be92', '72f03bc5-d0f8-4d92-98e2-e9b344676ad0', '4869734d-aa3d-490c-98a9-ed873b209596', 'a278306c-f89c-41be-af95-018af8afef8f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:06 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:06 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:06 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.320s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:06 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Deleted volume successfully. Sep 04 19:10:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c2629ab9-7c4c-4b3d-ad0d-20c665760ad9 tempest-AttachVolumeNegativeTest-23207716 None] Lock "cinder-616c3adf-018a-4ea5-adfe-206cf9de9425-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Flow 'volume_create_manager' (3aec6629-092f-48d2-b3f2-2023655cf866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62286983-4d63-4751-8e06-6fe044a658c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62286983-4d63-4751-8e06-6fe044a658c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-945693437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91df8142-4c4f-46da-b7c9-c7e7e54ccbbd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='23f345ec7a02418fafa0bf1e24d1c6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:08Z,use_quota=True,user_id='c3dd474c4a824eee9d5584c075667b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687238f7-826b-4ef1-b52f-227d7d084e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687238f7-826b-4ef1-b52f-227d7d084e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c389c25-0929-48e3-a148-709bf685315c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c389c25-0929-48e3-a148-709bf685315c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91df8142-4c4f-46da-b7c9-c7e7e54ccbbd', 'volume_name': 'volume-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4159193e-7a91-4c8f-9edd-0e875846e726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4159193e-7a91-4c8f-9edd-0e875846e726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa17aec1-fcf5-4d1f-83cb-1d2452685335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:07 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Volume 91df8142-4c4f-46da-b7c9-c7e7e54ccbbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd', 'volume_size': 1} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-945693437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91df8142-4c4f-46da-b7c9-c7e7e54ccbbd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='23f345ec7a02418fafa0bf1e24d1c6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:08Z,use_quota=True,user_id='c3dd474c4a824eee9d5584c075667b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Creating volume 91df8142-4c4f-46da-b7c9-c7e7e54ccbbd {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:10:07 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:10:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:07 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd 1073741824 Sep 04 19:10:07 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:08 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd 1073741824" returned: 0 in 0.691s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=97,cinder:SELECT=75,cinder:DELETE=11,cinder:INSERT=27 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=96,cinder:INSERT=16,cinder:UPDATE=99,cinder:DELETE=6 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:08 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd Sep 04 19:10:08 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "cinder-bec051c3-bfab-4a1d-90fe-95caa9572b49-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Lock "cinder-bec051c3-bfab-4a1d-90fe-95caa9572b49-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "cinder-quobyte-bec051c3-bfab-4a1d-90fe-95caa9572b49" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Lock "cinder-quobyte-bec051c3-bfab-4a1d-90fe-95caa9572b49" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:08 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd" returned: 0 in 0.415s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa17aec1-fcf5-4d1f-83cb-1d2452685335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40302aab-098b-41f1-b43d-34b90a1f4bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1e36f1-0f4f-4312-b6bd-d4e1b3feb482]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bec051c3-bfab-4a1d-90fe-95caa9572b49 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:08 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Volume volume-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd (91df8142-4c4f-46da-b7c9-c7e7e54ccbbd): created successfully Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40302aab-098b-41f1-b43d-34b90a1f4bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Flow 'volume_create_manager' (3aec6629-092f-48d2-b3f2-2023655cf866) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-edef94d0-56cb-4cd7-aae1-91e85fecdba5 tempest-VolumesGetTest-1894119627 None] Created volume successfully. Sep 04 19:10:09 devstack sudo[96049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bec051c3-bfab-4a1d-90fe-95caa9572b49 Sep 04 19:10:09 devstack sudo[96049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:09 devstack sudo[96049]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bec051c3-bfab-4a1d-90fe-95caa9572b49" returned: 0 in 0.391s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bec051c3-bfab-4a1d-90fe-95caa9572b49 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:09 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bec051c3-bfab-4a1d-90fe-95caa9572b49 Sep 04 19:10:09 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:09 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bec051c3-bfab-4a1d-90fe-95caa9572b49" returned: 0 in 0.333s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Lock "cinder-quobyte-bec051c3-bfab-4a1d-90fe-95caa9572b49" released by "delete_volume" :: held 0.807s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:09 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Created reservations ['6f60639e-77b3-4076-88c9-93ae4b593069', '90895565-4822-4118-b38b-1d640cf495d4', 'be689764-24b5-4864-ada6-23119df4c3ee', 'ab81c904-84c9-4b59-8a1d-ef2f8dde3718'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:09 devstack sudo[96058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:09 devstack sudo[96058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:10 devstack sudo[96058]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.340s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Deleted volume successfully. Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-26429677-44e0-487b-9eb3-7992d275e041 tempest-AttachVolumeNegativeTest-23207716 None] Lock "cinder-bec051c3-bfab-4a1d-90fe-95caa9572b49-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Flow 'volume_create_manager' (3dbc7f44-6f94-4324-9175-4634aa9610f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229063d4-a636-4b23-b1ce-9b7342de9cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (229063d4-a636-4b23-b1ce-9b7342de9cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-590035570',display_name='tempest-VolumesGetTest-Volume-1160884950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f68a83-f189-4386-9e70-34d56763b94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f345ec7a02418fafa0bf1e24d1c6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:11Z,use_quota=True,user_id='c3dd474c4a824eee9d5584c075667b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4bbe89-66c4-46aa-a0e6-c67d00991b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec4bbe89-66c4-46aa-a0e6-c67d00991b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b82fd58-8479-45b3-ab99-05c0efaa6f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b82fd58-8479-45b3-ab99-05c0efaa6f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13f68a83-f189-4386-9e70-34d56763b94a', 'volume_name': 'volume-13f68a83-f189-4386-9e70-34d56763b94a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95418806-21f4-4e23-861b-2223ff32e715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95418806-21f4-4e23-861b-2223ff32e715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff9fec2-959a-4ee8-bf1f-10bb1bab3e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:10 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Volume 13f68a83-f189-4386-9e70-34d56763b94a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13f68a83-f189-4386-9e70-34d56763b94a', 'volume_size': 1} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-590035570',display_name='tempest-VolumesGetTest-Volume-1160884950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f68a83-f189-4386-9e70-34d56763b94a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f345ec7a02418fafa0bf1e24d1c6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:11Z,use_quota=True,user_id='c3dd474c4a824eee9d5584c075667b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Creating volume 13f68a83-f189-4386-9e70-34d56763b94a {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:10:10 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-13f68a83-f189-4386-9e70-34d56763b94a 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "cinder-5944fc21-0575-4b28-a936-4018af34df93-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:10 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-13f68a83-f189-4386-9e70-34d56763b94a 1073741824 Sep 04 19:10:10 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Lock "cinder-5944fc21-0575-4b28-a936-4018af34df93-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "cinder-quobyte-5944fc21-0575-4b28-a936-4018af34df93" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Lock "cinder-quobyte-5944fc21-0575-4b28-a936-4018af34df93" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:11 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[663d3ddd-ddaa-4b40-9e90-76e60582cac3]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5944fc21-0575-4b28-a936-4018af34df93 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:11 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5944fc21-0575-4b28-a936-4018af34df93 Sep 04 19:10:11 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:11 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-13f68a83-f189-4386-9e70-34d56763b94a 1073741824" returned: 0 in 0.935s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-13f68a83-f189-4386-9e70-34d56763b94a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:11 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5944fc21-0575-4b28-a936-4018af34df93" returned: 0 in 0.835s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5944fc21-0575-4b28-a936-4018af34df93 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:11 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-13f68a83-f189-4386-9e70-34d56763b94a Sep 04 19:10:11 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:11 devstack sudo[96126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5944fc21-0575-4b28-a936-4018af34df93 Sep 04 19:10:11 devstack sudo[96126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:12 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-13f68a83-f189-4386-9e70-34d56763b94a" returned: 0 in 0.712s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] <== create_volume: return (1737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:10:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:12 devstack sudo[96126]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5944fc21-0575-4b28-a936-4018af34df93" returned: 0 in 0.693s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Lock "cinder-quobyte-5944fc21-0575-4b28-a936-4018af34df93" released by "delete_volume" :: held 1.586s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ff9fec2-959a-4ee8-bf1f-10bb1bab3e6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f68a83-f189-4386-9e70-34d56763b94a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d102e9-51b8-4c16-91ef-5a9a68864021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:12 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Volume volume-13f68a83-f189-4386-9e70-34d56763b94a (13f68a83-f189-4386-9e70-34d56763b94a): created successfully Sep 04 19:10:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9d102e9-51b8-4c16-91ef-5a9a68864021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Flow 'volume_create_manager' (3dbc7f44-6f94-4324-9175-4634aa9610f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:12 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0e9b91bc-733f-4e67-8700-04e0dff0b475 tempest-VolumesGetTest-1894119627 None] Created volume successfully. Sep 04 19:10:12 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Created reservations ['82c4f966-ef97-4e04-8897-500f1613c3c8', '0ece5ed6-1f4a-48eb-83b0-cdf4f01cc6fd', '08d44a7a-bc0b-441c-bfe9-55630e74edd9', '872d96a4-76ec-41d4-a471-f2ed7f209ffa'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:12 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:12 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Acquiring lock "cinder-13f68a83-f189-4386-9e70-34d56763b94a-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:13 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.455s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:13 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Lock "cinder-13f68a83-f189-4386-9e70-34d56763b94a-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Deleted volume successfully. Sep 04 19:10:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "cinder-b1ddce13-50e7-4acb-a90a-583a84e4e998-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-634aedef-3188-41c3-a474-46685b17585f tempest-AttachVolumeTestJSON-1764077708 None] Lock "cinder-5944fc21-0575-4b28-a936-4018af34df93-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Acquiring lock "cinder-quobyte-13f68a83-f189-4386-9e70-34d56763b94a" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Lock "cinder-b1ddce13-50e7-4acb-a90a-583a84e4e998-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-13f68a83-f189-4386-9e70-34d56763b94a" acquired by "delete_volume" :: waited 0.062s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5183db-31b8-44b7-9209-dd03f764e1d9]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-13f68a83-f189-4386-9e70-34d56763b94a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "cinder-quobyte-b1ddce13-50e7-4acb-a90a-583a84e4e998" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Lock "cinder-quobyte-b1ddce13-50e7-4acb-a90a-583a84e4e998" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2eba2e-7ca7-49f3-9710-a16b298b93c9]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ddce13-50e7-4acb-a90a-583a84e4e998 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:13 devstack sudo[96153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-13f68a83-f189-4386-9e70-34d56763b94a Sep 04 19:10:13 devstack sudo[96153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:13 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ddce13-50e7-4acb-a90a-583a84e4e998 Sep 04 19:10:13 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:14 devstack sudo[96153]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-13f68a83-f189-4386-9e70-34d56763b94a" returned: 0 in 0.720s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-13f68a83-f189-4386-9e70-34d56763b94a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:14 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ddce13-50e7-4acb-a90a-583a84e4e998" returned: 0 in 0.544s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ddce13-50e7-4acb-a90a-583a84e4e998 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:14 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-13f68a83-f189-4386-9e70-34d56763b94a Sep 04 19:10:14 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:14 devstack sudo[96165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ddce13-50e7-4acb-a90a-583a84e4e998 Sep 04 19:10:14 devstack sudo[96165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:14 devstack sudo[96165]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ddce13-50e7-4acb-a90a-583a84e4e998" returned: 0 in 0.327s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Lock "cinder-quobyte-b1ddce13-50e7-4acb-a90a-583a84e4e998" released by "delete_volume" :: held 0.969s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:14 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Created reservations ['e326deec-82ee-4ba1-93bb-249a98d56f59', '19bc5d06-ed36-4c7e-8776-8d19ed8d606e', '1a351ce7-fd22-48b7-9839-06394cf75b25', 'ed04d795-6a7f-4935-ae81-3314602cefd9'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:14 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-13f68a83-f189-4386-9e70-34d56763b94a" returned: 0 in 0.495s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-13f68a83-f189-4386-9e70-34d56763b94a" released by "delete_volume" :: held 1.309s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Created reservations ['65af6c45-72c9-4fbb-838e-7d8bafdb012c', 'f7540025-623b-4dd0-b6db-81da2f27626c', '3f3dd594-cf58-45ac-8b6c-e59efdada580', '7f67cb63-f9a2-4965-bcf8-c71f89b3ecc1'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:15 devstack sudo[96170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:15 devstack sudo[96170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:15 devstack sudo[96172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:15 devstack sudo[96172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:15 devstack sudo[96170]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.358s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Deleted volume successfully. Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-149385de-59ac-44ef-8093-20c0a5829415 tempest-AttachVolumeTestJSON-1764077708 None] Lock "cinder-b1ddce13-50e7-4acb-a90a-583a84e4e998-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:15 devstack sudo[96172]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.364s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Deleted volume successfully. Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-31c987d6-c03d-46a8-8bce-fbfbc6c90dd8 tempest-VolumesGetTest-1894119627 None] Lock "cinder-13f68a83-f189-4386-9e70-34d56763b94a-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Acquiring lock "cinder-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Lock "cinder-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Acquiring lock "cinder-quobyte-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd" acquired by "delete_volume" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4f9641-18ea-4ea9-8dd8-6d343dd9b22e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "cinder-c51df7dd-8faf-4d9e-9e34-9630e7fc927f-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Lock "cinder-c51df7dd-8faf-4d9e-9e34-9630e7fc927f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "cinder-quobyte-c51df7dd-8faf-4d9e-9e34-9630e7fc927f" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:16 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd Sep 04 19:10:16 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Lock "cinder-quobyte-c51df7dd-8faf-4d9e-9e34-9630e7fc927f" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:16 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c633660-f1c2-481f-84ce-caa5271e5be3]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:16 devstack sudo[96178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f Sep 04 19:10:16 devstack sudo[96178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:16 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd" returned: 0 in 0.651s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:16 devstack sudo[96183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd Sep 04 19:10:16 devstack sudo[96183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:16 devstack sudo[96178]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f" returned: 0 in 0.748s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:16 devstack sudo[96192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f Sep 04 19:10:16 devstack sudo[96192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:17 devstack sudo[96183]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd" returned: 0 in 0.476s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd" released by "delete_volume" :: held 1.220s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Created reservations ['17d37632-ca9f-4e77-9545-10416c873014', 'f4aae2e7-323f-499c-af6f-5cb08d432f0d', '08840d5c-222a-4466-a848-133f071320cf', 'e8f2a445-aaab-4e10-8370-76bfeb653a0d'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:17 devstack sudo[96192]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:17 devstack sudo[96196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:17 devstack sudo[96196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c51df7dd-8faf-4d9e-9e34-9630e7fc927f" returned: 0 in 0.498s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Lock "cinder-quobyte-c51df7dd-8faf-4d9e-9e34-9630e7fc927f" released by "delete_volume" :: held 1.311s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Created reservations ['8b8dd775-067f-4598-96bb-416806803e6a', '70dd8376-35c2-4ff0-8acb-092bde80dd4b', '8719fa43-fa62-4ce4-a5f5-4ae398e4253e', '0605ba22-348c-43c6-8e9d-61aa89cda488'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:17 devstack sudo[96196]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.411s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:17 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:17 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Deleted volume successfully. Sep 04 19:10:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-796956e1-af49-4128-8699-d42984374060 tempest-VolumesGetTest-1894119627 None] Lock "cinder-91df8142-4c4f-46da-b7c9-c7e7e54ccbbd-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:18 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.532s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:18 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Deleted volume successfully. Sep 04 19:10:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aff12bff-829f-4304-8492-e89d7401e7ea tempest-AttachVolumeTestJSON-1764077708 None] Lock "cinder-c51df7dd-8faf-4d9e-9e34-9630e7fc927f-delete_volume" released by "delete_volume" :: held 2.238s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Flow 'volume_create_manager' (3a4c9f3e-3a6a-4d3a-88f8-0c693c59338b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e80e616-460b-4392-8358-29931d3a334a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e80e616-460b-4392-8358-29931d3a334a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2094718706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f9d43c-ad40-4ee3-9b15-edc9760798a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f345ec7a02418fafa0bf1e24d1c6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:19Z,use_quota=True,user_id='c3dd474c4a824eee9d5584c075667b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8470586-8a00-4476-afb3-5f38b51db415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8470586-8a00-4476-afb3-5f38b51db415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1971b717-a7cf-4c40-aa03-3919c1d865f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1971b717-a7cf-4c40-aa03-3919c1d865f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f9d43c-ad40-4ee3-9b15-edc9760798a7', 'volume_name': 'volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05706958-ad6b-4839-bed9-5c3152935280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05706958-ad6b-4839-bed9-5c3152935280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27bfc5d8-815e-48eb-b76f-1894b10e992b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:19 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Volume 17f9d43c-ad40-4ee3-9b15-edc9760798a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7', 'volume_size': 1} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2094718706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f9d43c-ad40-4ee3-9b15-edc9760798a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f345ec7a02418fafa0bf1e24d1c6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:19Z,use_quota=True,user_id='c3dd474c4a824eee9d5584c075667b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Creating volume 17f9d43c-ad40-4ee3-9b15-edc9760798a7 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:10:19 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:10:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:19 devstack sudo[96204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 1073741824 Sep 04 19:10:19 devstack sudo[96204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:20 devstack sudo[96204]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 1073741824" returned: 0 in 0.953s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:20 devstack sudo[96223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 Sep 04 19:10:20 devstack sudo[96223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:20 devstack sudo[96223]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7" returned: 0 in 0.378s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] <== create_volume: return (1418ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:10:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27bfc5d8-815e-48eb-b76f-1894b10e992b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a23e366f-74eb-486e-b265-0df3beb3b74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:20 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Volume volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 (17f9d43c-ad40-4ee3-9b15-edc9760798a7): created successfully Sep 04 19:10:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a23e366f-74eb-486e-b265-0df3beb3b74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Flow 'volume_create_manager' (3a4c9f3e-3a6a-4d3a-88f8-0c693c59338b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:20 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-04f833ab-a0da-4b8b-a9f6-1a62478aa4f2 tempest-VolumesGetTest-1894119627 None] Created volume successfully. Sep 04 19:10:22 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:10:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Flow 'volume_create_manager' (25e40257-e36e-4200-a77d-6516db9e4d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7526ec-110c-4e4b-9b71-63dd9de4e126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a7526ec-110c-4e4b-9b71-63dd9de4e126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1356842744',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab5f914-171f-419a-8052-b51ef62551a6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='23f345ec7a02418fafa0bf1e24d1c6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=17f9d43c-ad40-4ee3-9b15-edc9760798a7,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:22Z,use_quota=True,user_id='c3dd474c4a824eee9d5584c075667b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797fe349-1a6e-4c54-a079-10df21b4c709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797fe349-1a6e-4c54-a079-10df21b4c709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f7db79e-514d-43d6-a6fb-5b3436d07014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f7db79e-514d-43d6-a6fb-5b3436d07014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'bab5f914-171f-419a-8052-b51ef62551a6', 'volume_name': 'volume-bab5f914-171f-419a-8052-b51ef62551a6', 'volume_size': 1, 'source_volid': '17f9d43c-ad40-4ee3-9b15-edc9760798a7', 'source_volstatus': 'available'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a903fc8-be36-4a4c-9f03-d5ac8f01d081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a903fc8-be36-4a4c-9f03-d5ac8f01d081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff220a12-f539-4ba9-bae3-432a57eb29bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:22 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Volume bab5f914-171f-419a-8052-b51ef62551a6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-bab5f914-171f-419a-8052-b51ef62551a6', 'volume_size': 1, 'source_volid': '17f9d43c-ad40-4ee3-9b15-edc9760798a7', 'source_volstatus': 'available'} Sep 04 19:10:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:22 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Cloning volume 17f9d43c-ad40-4ee3-9b15-edc9760798a7 to volume bab5f914-171f-419a-8052-b51ef62551a6 Sep 04 19:10:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Creating offline snapshot 06a22d2e-dd87-44ab-8fd2-817956f02eae of volume 17f9d43c-ad40-4ee3-9b15-edc9760798a7 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:10:22 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a0c7a7-ca5f-4cea-acd4-ec1f47d9b8d4]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:22 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 Sep 04 19:10:22 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:23 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7" returned: 0 in 0.603s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:23 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae 1G Sep 04 19:10:23 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:24 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae 1G" returned: 0 in 1.027s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:24 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae Sep 04 19:10:24 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:24 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae" returned: 0 in 0.738s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:24 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae is being set with open permissions: ugo+rw Sep 04 19:10:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:24 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae Sep 04 19:10:24 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae" returned: 0 in 0.737s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:25 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:25 devstack sudo[96326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.info Sep 04 19:10:25 devstack sudo[96326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:26 devstack sudo[96326]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.info" returned: 0 in 0.769s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:26 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.info is being set with open permissions: ugo+rw Sep 04 19:10:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:26 devstack sudo[96349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.info Sep 04 19:10:26 devstack sudo[96349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:26 devstack sudo[96349]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.info" returned: 0 in 0.445s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Acquiring lock "cinder-quobyte-bab5f914-171f-419a-8052-b51ef62551a6" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-bab5f914-171f-419a-8052-b51ef62551a6" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] snapshot: 06a22d2e-dd87-44ab-8fd2-817956f02eae, volume: bab5f914-171f-419a-8052-b51ef62551a6, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 19:10:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:26 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2266f711-3e37-4efb-8beb-14b665d8b1f9]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:27 devstack sudo[96354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae Sep 04 19:10:27 devstack sudo[96354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:27 devstack sudo[96354]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae" returned: 0 in 0.526s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:10:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6b792b-4bee-4526-bf57-35e804a43433]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:27 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 Sep 04 19:10:27 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:28 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7" returned: 0 in 0.620s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Path /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab5f914-171f-419a-8052-b51ef62551a6 not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab5f914-171f-419a-8052-b51ef62551a6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:28 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab5f914-171f-419a-8052-b51ef62551a6 Sep 04 19:10:28 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Flow 'volume_create_manager' (3ee674b2-4f03-4524-ad53-24c91fa64d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcb3f2b-5022-4f8e-8624-331b1f630bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bcb3f2b-5022-4f8e-8624-331b1f630bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1095865533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c646f5aa-40af-4594-8751-0312f3fb627c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c8fd5488239410a9f525436c31829dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:28Z,use_quota=True,user_id='8d966233363441b4a3549a6d9cb9d24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9662132-7472-4676-95df-88c56f70bc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9662132-7472-4676-95df-88c56f70bc76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b3073a-9b23-4d75-95b5-697f3a11972e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44b3073a-9b23-4d75-95b5-697f3a11972e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c646f5aa-40af-4594-8751-0312f3fb627c', 'volume_name': 'volume-c646f5aa-40af-4594-8751-0312f3fb627c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55adc8dc-08ee-47f9-8861-24655e090138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55adc8dc-08ee-47f9-8861-24655e090138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52145d8-d846-4065-b5db-4d82fb0f4020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:28 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Volume c646f5aa-40af-4594-8751-0312f3fb627c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c646f5aa-40af-4594-8751-0312f3fb627c', 'volume_size': 1} Sep 04 19:10:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:34 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab5f914-171f-419a-8052-b51ef62551a6" returned: 0 in 6.512s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:34 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7, size 1024.00 MB, duration 6.51 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab5f914-171f-419a-8052-b51ef62551a6 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:10:34 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Converted 1024.00 MB image at 157.23 MB/s Sep 04 19:10:34 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab5f914-171f-419a-8052-b51ef62551a6 is being set with open permissions: ugo+rw Sep 04 19:10:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab5f914-171f-419a-8052-b51ef62551a6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:34 devstack sudo[96405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab5f914-171f-419a-8052-b51ef62551a6 Sep 04 19:10:34 devstack sudo[96405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:34 devstack sudo[96405]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab5f914-171f-419a-8052-b51ef62551a6" returned: 0 in 0.287s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-bab5f914-171f-419a-8052-b51ef62551a6" released by "_copy_volume_from_snapshot" :: held 8.079s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Acquiring lock "cinder-quobyte-06a22d2e-dd87-44ab-8fd2-817956f02eae" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-06a22d2e-dd87-44ab-8fd2-817956f02eae" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Deleting offline snapshot 06a22d2e-dd87-44ab-8fd2-817956f02eae of volume 17f9d43c-ad40-4ee3-9b15-edc9760798a7 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] snapshot_file for this snap is: volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a69954d-9ad6-44ab-91ec-6422bb9b50e6]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:35 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae Sep 04 19:10:35 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Flow 'volume_create_manager' (b9182cab-22eb-4bc0-a0fc-5f550b330300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744fd68d-2699-454c-a258-09bfa5a2ba08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (744fd68d-2699-454c-a258-09bfa5a2ba08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-55485025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44791a8d-f4f8-4330-98a5-e4a6d80005e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8c22f9a77b54fafb9c4b34135de81e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:35Z,use_quota=True,user_id='7028bedfa7a84f5487a701112a800516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6420361b-98d4-4913-84cc-3e663bc0e5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6420361b-98d4-4913-84cc-3e663bc0e5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d90171-21c9-4a00-93b7-7138d34df672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d90171-21c9-4a00-93b7-7138d34df672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44791a8d-f4f8-4330-98a5-e4a6d80005e3', 'volume_name': 'volume-44791a8d-f4f8-4330-98a5-e4a6d80005e3', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac397c23-95ab-4677-9da5-5d3e779b528e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac397c23-95ab-4677-9da5-5d3e779b528e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e90276-870c-49a6-ae09-355581f40f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:35 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Volume 44791a8d-f4f8-4330-98a5-e4a6d80005e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44791a8d-f4f8-4330-98a5-e4a6d80005e3', 'volume_size': 1} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:35 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae" returned: 0 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[595b4981-c1b7-4cc8-a8a3-7fe595562815]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:35 devstack sudo[96414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 Sep 04 19:10:35 devstack sudo[96414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:35 devstack sudo[96414]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7" returned: 0 in 0.534s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:36 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae Sep 04 19:10:36 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:36 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae" returned: 0 in 0.346s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:36 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae Sep 04 19:10:36 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:36 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7.06a22d2e-dd87-44ab-8fd2-817956f02eae" returned: 0 in 0.237s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-06a22d2e-dd87-44ab-8fd2-817956f02eae" released by "_delete_snapshot" :: held 1.610s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.341s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.319s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1095865533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c646f5aa-40af-4594-8751-0312f3fb627c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c8fd5488239410a9f525436c31829dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:28Z,use_quota=True,user_id='8d966233363441b4a3549a6d9cb9d24e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Creating volume c646f5aa-40af-4594-8751-0312f3fb627c {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:10:36 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff220a12-f539-4ba9-bae3-432a57eb29bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bab5f914-171f-419a-8052-b51ef62551a6', 'volume_size': 1, 'source_volid': '17f9d43c-ad40-4ee3-9b15-edc9760798a7', 'source_volstatus': 'available'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:36 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c 1073741824 Sep 04 19:10:36 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c657b5-8346-425e-b42d-33b0570ac7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:36 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Volume volume-bab5f914-171f-419a-8052-b51ef62551a6 (bab5f914-171f-419a-8052-b51ef62551a6): created successfully Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75c657b5-8346-425e-b42d-33b0570ac7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Flow 'volume_create_manager' (25e40257-e36e-4200-a77d-6516db9e4d83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-77048ec9-a948-42f9-9e1a-3709498ac27b tempest-VolumesGetTest-1894119627 None] Created volume successfully. Sep 04 19:10:37 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c 1073741824" returned: 0 in 0.453s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:37 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c Sep 04 19:10:37 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:37 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c" returned: 0 in 0.260s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.104s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-55485025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44791a8d-f4f8-4330-98a5-e4a6d80005e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8c22f9a77b54fafb9c4b34135de81e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:35Z,use_quota=True,user_id='7028bedfa7a84f5487a701112a800516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Creating volume 44791a8d-f4f8-4330-98a5-e4a6d80005e3 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:10:37 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44791a8d-f4f8-4330-98a5-e4a6d80005e3 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f52145d8-d846-4065-b5db-4d82fb0f4020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c646f5aa-40af-4594-8751-0312f3fb627c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90318c85-2a4a-4dff-bc7c-8b2a033ece6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:37 devstack sudo[96437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44791a8d-f4f8-4330-98a5-e4a6d80005e3 1073741824 Sep 04 19:10:37 devstack sudo[96437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:37 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Volume volume-c646f5aa-40af-4594-8751-0312f3fb627c (c646f5aa-40af-4594-8751-0312f3fb627c): created successfully Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90318c85-2a4a-4dff-bc7c-8b2a033ece6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Flow 'volume_create_manager' (3ee674b2-4f03-4524-ad53-24c91fa64d75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-15c103ba-70c9-46f4-85f8-f8a3cf64bdd9 req-1f2b51f2-d6f9-4f63-8e03-fa0449a04b5b tempest-VolumesSnapshotsTestJSON-1706701148 None] Created volume successfully. Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Flow 'volume_create_manager' (b0527d4a-d099-40d0-aa40-f9f2cfa39699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39632563-c328-428f-be2b-758c53de818f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39632563-c328-428f-be2b-758c53de818f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-808364638',display_name='tempest-VolumesGetTest-Volume-1976467690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b15cac-3153-4bfb-bba5-f3f834b10903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f345ec7a02418fafa0bf1e24d1c6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:38Z,use_quota=True,user_id='c3dd474c4a824eee9d5584c075667b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417eb8ed-72cc-4eef-be17-268007dcd354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (417eb8ed-72cc-4eef-be17-268007dcd354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d972fc-9d44-4888-9c71-a2de6bfeedc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71d972fc-9d44-4888-9c71-a2de6bfeedc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b15cac-3153-4bfb-bba5-f3f834b10903', 'volume_name': 'volume-50b15cac-3153-4bfb-bba5-f3f834b10903', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a8fe77-0dab-45f6-b9d4-c4eb794e8617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5a8fe77-0dab-45f6-b9d4-c4eb794e8617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec910e2d-4c59-488b-a5a8-d947f9d43783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:37 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Volume 50b15cac-3153-4bfb-bba5-f3f834b10903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b15cac-3153-4bfb-bba5-f3f834b10903', 'volume_size': 1} Sep 04 19:10:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:38 devstack sudo[96437]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44791a8d-f4f8-4330-98a5-e4a6d80005e3 1073741824" returned: 0 in 0.674s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44791a8d-f4f8-4330-98a5-e4a6d80005e3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:38 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44791a8d-f4f8-4330-98a5-e4a6d80005e3 Sep 04 19:10:38 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:38 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44791a8d-f4f8-4330-98a5-e4a6d80005e3" returned: 0 in 0.323s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.705s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:37Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-808364638',display_name='tempest-VolumesGetTest-Volume-1976467690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b15cac-3153-4bfb-bba5-f3f834b10903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f345ec7a02418fafa0bf1e24d1c6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:38Z,use_quota=True,user_id='c3dd474c4a824eee9d5584c075667b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Creating volume 50b15cac-3153-4bfb-bba5-f3f834b10903 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:10:38 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-50b15cac-3153-4bfb-bba5-f3f834b10903 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63e90276-870c-49a6-ae09-355581f40f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44791a8d-f4f8-4330-98a5-e4a6d80005e3', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:38 devstack sudo[96446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-50b15cac-3153-4bfb-bba5-f3f834b10903 1073741824 Sep 04 19:10:38 devstack sudo[96446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfa5f27-ea2f-4870-9e7b-03717ebd1858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:38 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Volume volume-44791a8d-f4f8-4330-98a5-e4a6d80005e3 (44791a8d-f4f8-4330-98a5-e4a6d80005e3): created successfully Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dfa5f27-ea2f-4870-9e7b-03717ebd1858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Flow 'volume_create_manager' (b9182cab-22eb-4bc0-a0fc-5f550b330300) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d7e18823-2f0b-477d-90b5-14eaeb766bc6 tempest-ServersNegativeTestJSON-143013472 None] Created volume successfully. Sep 04 19:10:39 devstack sudo[96446]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-50b15cac-3153-4bfb-bba5-f3f834b10903 1073741824" returned: 0 in 0.533s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-50b15cac-3153-4bfb-bba5-f3f834b10903 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:39 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-50b15cac-3153-4bfb-bba5-f3f834b10903 Sep 04 19:10:39 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:39 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-50b15cac-3153-4bfb-bba5-f3f834b10903" returned: 0 in 0.253s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.951s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec910e2d-4c59-488b-a5a8-d947f9d43783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b15cac-3153-4bfb-bba5-f3f834b10903', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616633b9-a7dd-4ab0-9c44-39e78be70c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] Creating offline snapshot ec816efc-5e3f-4654-ad71-d4caa169a6b4 of volume c646f5aa-40af-4594-8751-0312f3fb627c {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:10:39 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Volume volume-50b15cac-3153-4bfb-bba5-f3f834b10903 (50b15cac-3153-4bfb-bba5-f3f834b10903): created successfully Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (616633b9-a7dd-4ab0-9c44-39e78be70c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Flow 'volume_create_manager' (b0527d4a-d099-40d0-aa40-f9f2cfa39699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad1ec12-ed93-40d9-bb59-d8db22724574]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-86aa9df4-ff92-4225-af1b-936e802fe23a tempest-VolumesGetTest-1894119627 None] Created volume successfully. Sep 04 19:10:39 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c Sep 04 19:10:39 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:39 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c" returned: 0 in 0.473s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:39 devstack sudo[96462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4 1G Sep 04 19:10:39 devstack sudo[96462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Acquiring lock "cinder-50b15cac-3153-4bfb-bba5-f3f834b10903-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Lock "cinder-50b15cac-3153-4bfb-bba5-f3f834b10903-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Acquiring lock "cinder-quobyte-50b15cac-3153-4bfb-bba5-f3f834b10903" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-50b15cac-3153-4bfb-bba5-f3f834b10903" acquired by "delete_volume" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1de8fa-9d9a-4300-8ad7-5f9296101c13]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-50b15cac-3153-4bfb-bba5-f3f834b10903 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:40 devstack sudo[96464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-50b15cac-3153-4bfb-bba5-f3f834b10903 Sep 04 19:10:40 devstack sudo[96464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:40 devstack sudo[96462]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4 1G" returned: 0 in 0.621s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c646f5aa-40af-4594-8751-0312f3fb627c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:40 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c646f5aa-40af-4594-8751-0312f3fb627c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4 Sep 04 19:10:40 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:40 devstack sudo[96464]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-50b15cac-3153-4bfb-bba5-f3f834b10903" returned: 0 in 0.490s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-50b15cac-3153-4bfb-bba5-f3f834b10903 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:40 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-50b15cac-3153-4bfb-bba5-f3f834b10903 Sep 04 19:10:40 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:40 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c646f5aa-40af-4594-8751-0312f3fb627c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4" returned: 0 in 0.359s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:40 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4 is being set with open permissions: ugo+rw Sep 04 19:10:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:40 devstack sudo[96481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4 Sep 04 19:10:40 devstack sudo[96481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:40 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-50b15cac-3153-4bfb-bba5-f3f834b10903" returned: 0 in 0.346s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-50b15cac-3153-4bfb-bba5-f3f834b10903" released by "delete_volume" :: held 0.923s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Created reservations ['25eb5f9d-1484-4d09-9d50-afe5dca1c70e', 'af469d6b-6874-42b6-9c48-d3d201c55ff4', '8047f7f3-3c0c-4832-b8fa-a974ccb0bea6', 'e5f9c784-10fd-4a7e-b3f3-e8c3a190fe15'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:41 devstack sudo[96481]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4" returned: 0 in 0.401s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:41 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:41 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:41 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.info Sep 04 19:10:41 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Flow 'volume_create_manager' (b27bc930-0611-487f-8f8f-ba551f3e6f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2646a515-33f9-4f73-85c5-1750bf2a8e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2646a515-33f9-4f73-85c5-1750bf2a8e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-452294156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314ecd66-1979-4b40-8ae1-1aedcdcb883b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8c22f9a77b54fafb9c4b34135de81e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:41Z,use_quota=True,user_id='7028bedfa7a84f5487a701112a800516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66a00a9-e274-4656-9476-f8bbece177d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e66a00a9-e274-4656-9476-f8bbece177d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93c1ad8-aa3d-431b-836f-6de289a25890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f93c1ad8-aa3d-431b-836f-6de289a25890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '314ecd66-1979-4b40-8ae1-1aedcdcb883b', 'volume_name': 'volume-314ecd66-1979-4b40-8ae1-1aedcdcb883b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca12f8c1-8cb7-4f90-a8ee-1200dad2940b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca12f8c1-8cb7-4f90-a8ee-1200dad2940b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1539b130-f659-4eef-9635-5a79579f18e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:41 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Volume 314ecd66-1979-4b40-8ae1-1aedcdcb883b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-314ecd66-1979-4b40-8ae1-1aedcdcb883b', 'volume_size': 1} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:41 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.336s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Deleted volume successfully. Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0780d86c-a52e-4b73-8b20-c0a995b6792a tempest-VolumesGetTest-1894119627 None] Lock "cinder-50b15cac-3153-4bfb-bba5-f3f834b10903-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:41 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.info" returned: 0 in 0.359s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:41 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.info is being set with open permissions: ugo+rw Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:41 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.info Sep 04 19:10:41 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:41 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.info" returned: 0 in 0.282s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.622s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.530s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-452294156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314ecd66-1979-4b40-8ae1-1aedcdcb883b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8c22f9a77b54fafb9c4b34135de81e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:41Z,use_quota=True,user_id='7028bedfa7a84f5487a701112a800516',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Creating volume 314ecd66-1979-4b40-8ae1-1aedcdcb883b {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:10:41 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:10:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-314ecd66-1979-4b40-8ae1-1aedcdcb883b 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:42 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-314ecd66-1979-4b40-8ae1-1aedcdcb883b 1073741824 Sep 04 19:10:42 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-cba90372-f448-497e-a5e5-cd82fd2a718d req-85c9986c-1802-4edc-a4bb-2949f69a20ca tempest-VolumesSnapshotsTestJSON-1706701148 None] Create snapshot completed successfully Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Acquiring lock "cinder-bab5f914-171f-419a-8052-b51ef62551a6-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Acquiring lock "cinder-ec816efc-5e3f-4654-ad71-d4caa169a6b4-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Lock "cinder-bab5f914-171f-419a-8052-b51ef62551a6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "cinder-ec816efc-5e3f-4654-ad71-d4caa169a6b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Acquiring lock "cinder-quobyte-c646f5aa-40af-4594-8751-0312f3fb627c" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Acquiring lock "cinder-quobyte-bab5f914-171f-419a-8052-b51ef62551a6" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "cinder-quobyte-c646f5aa-40af-4594-8751-0312f3fb627c" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Acquiring lock "cinder-quobyte-ec816efc-5e3f-4654-ad71-d4caa169a6b4" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "cinder-quobyte-ec816efc-5e3f-4654-ad71-d4caa169a6b4" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Deleting offline snapshot ec816efc-5e3f-4654-ad71-d4caa169a6b4 of volume c646f5aa-40af-4594-8751-0312f3fb627c {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] snapshot_file for this snap is: volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-bab5f914-171f-419a-8052-b51ef62551a6" acquired by "delete_volume" :: waited 0.056s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6cd6c5-e126-49d7-b6a5-e8ef7b3e612c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8399d838-1c5f-4376-a7dd-5d4c78453919]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab5f914-171f-419a-8052-b51ef62551a6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:42 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-314ecd66-1979-4b40-8ae1-1aedcdcb883b 1073741824" returned: 0 in 0.627s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-314ecd66-1979-4b40-8ae1-1aedcdcb883b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:42 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-314ecd66-1979-4b40-8ae1-1aedcdcb883b Sep 04 19:10:42 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:42 devstack sudo[96499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4 Sep 04 19:10:42 devstack sudo[96499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:42 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab5f914-171f-419a-8052-b51ef62551a6 Sep 04 19:10:42 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:42 devstack sudo[96499]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4" returned: 0 in 0.421s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c646f5aa-40af-4594-8751-0312f3fb627c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:10:43 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-314ecd66-1979-4b40-8ae1-1aedcdcb883b" returned: 0 in 0.352s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1539b130-f659-4eef-9635-5a79579f18e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-314ecd66-1979-4b40-8ae1-1aedcdcb883b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd66dadc-ea26-4470-815b-5c03e2e4d595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e0006f-ea4a-4284-b660-4ab0995718e2]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:43 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab5f914-171f-419a-8052-b51ef62551a6" returned: 0 in 0.466s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab5f914-171f-419a-8052-b51ef62551a6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:43 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Volume volume-314ecd66-1979-4b40-8ae1-1aedcdcb883b (314ecd66-1979-4b40-8ae1-1aedcdcb883b): created successfully Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd66dadc-ea26-4470-815b-5c03e2e4d595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Flow 'volume_create_manager' (b27bc930-0611-487f-8f8f-ba551f3e6f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:43 devstack sudo[96514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab5f914-171f-419a-8052-b51ef62551a6 Sep 04 19:10:43 devstack sudo[96514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8b9f3a3b-6a66-4379-950d-5a589b49f562 tempest-ServersNegativeTestJSON-143013472 None] Created volume successfully. Sep 04 19:10:43 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c Sep 04 19:10:43 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:43 devstack sudo[96514]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab5f914-171f-419a-8052-b51ef62551a6" returned: 0 in 0.275s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-bab5f914-171f-419a-8052-b51ef62551a6" released by "delete_volume" :: held 0.808s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Created reservations ['15201899-4d72-4a45-a983-0a98e72ce506', '197ff7c3-1b05-497a-8d70-45fdebc6dc07', 'd2116c42-54a5-4675-89c2-224a4cb89812', 'fb2a0ce9-0765-4e01-9d80-d63d4fba6533'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:43 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c" returned: 0 in 0.455s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:43 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4 Sep 04 19:10:43 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:43 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:43 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Acquiring lock "cinder-17f9d43c-ad40-4ee3-9b15-edc9760798a7-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Lock "cinder-17f9d43c-ad40-4ee3-9b15-edc9760798a7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Acquiring lock "cinder-quobyte-17f9d43c-ad40-4ee3-9b15-edc9760798a7" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-17f9d43c-ad40-4ee3-9b15-edc9760798a7" acquired by "delete_volume" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:43 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.386s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:43 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Deleted volume successfully. Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ecb0f3-ed1c-4b3d-8c9e-ee4fdf2996de]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e27428c2-f4cb-40af-a285-509b9101dcb8 tempest-VolumesGetTest-1894119627 None] Lock "cinder-bab5f914-171f-419a-8052-b51ef62551a6-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:44 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4" returned: 0 in 0.626s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:44 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 Sep 04 19:10:44 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:44 devstack sudo[96530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4 Sep 04 19:10:44 devstack sudo[96530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Acquiring lock "cinder-314ecd66-1979-4b40-8ae1-1aedcdcb883b-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Lock "cinder-314ecd66-1979-4b40-8ae1-1aedcdcb883b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Acquiring lock "cinder-quobyte-314ecd66-1979-4b40-8ae1-1aedcdcb883b" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Lock "cinder-quobyte-314ecd66-1979-4b40-8ae1-1aedcdcb883b" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a9b7d9-1fc9-4cf4-b4e6-3b6f33ad26ea]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-314ecd66-1979-4b40-8ae1-1aedcdcb883b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:44 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7" returned: 0 in 0.450s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:44 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-314ecd66-1979-4b40-8ae1-1aedcdcb883b Sep 04 19:10:44 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:44 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7 Sep 04 19:10:44 devstack sudo[96530]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:44 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c.ec816efc-5e3f-4654-ad71-d4caa169a6b4" returned: 0 in 0.372s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "cinder-quobyte-ec816efc-5e3f-4654-ad71-d4caa169a6b4" released by "_delete_snapshot" :: held 2.027s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "cinder-quobyte-c646f5aa-40af-4594-8751-0312f3fb627c" released by "delete_snapshot" :: held 2.069s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG cinder.quota [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Created reservations ['3dc611b4-e7ab-4270-a6c0-39a3ec177a79', 'e6c09696-2e30-4344-9aa8-1d34f1000224', '65068618-edc8-4ed7-bd9e-5d22ccd1897a', 'de1aa518-8a25-4a81-9afb-8bf2bed246f5'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:44 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-17f9d43c-ad40-4ee3-9b15-edc9760798a7" returned: 0 in 0.297s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:44 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-314ecd66-1979-4b40-8ae1-1aedcdcb883b" returned: 0 in 0.437s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-314ecd66-1979-4b40-8ae1-1aedcdcb883b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-17f9d43c-ad40-4ee3-9b15-edc9760798a7" released by "delete_volume" :: held 0.871s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:44 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-314ecd66-1979-4b40-8ae1-1aedcdcb883b Sep 04 19:10:44 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Delete snapshot completed successfully. Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-8d8a057c-fa39-48e2-a3dc-9606a4941694 req-8798e460-1bff-4479-95e9-5f7eafc75160 tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "cinder-ec816efc-5e3f-4654-ad71-d4caa169a6b4-delete_snapshot" released by "delete_snapshot" :: held 2.386s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Created reservations ['bfccf600-8ea6-44af-b2ad-a4de4d4cd097', '1a295f48-a0b2-4bbf-9e67-f38ddc017add', '6fe466f8-d3e5-477b-9991-c0b0d9a7e1ae', 'c9e51f5f-20a5-4b3b-a1ba-e112e39508ec'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:45 devstack sudo[96548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:45 devstack sudo[96548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:45 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-314ecd66-1979-4b40-8ae1-1aedcdcb883b" returned: 0 in 0.324s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Lock "cinder-quobyte-314ecd66-1979-4b40-8ae1-1aedcdcb883b" released by "delete_volume" :: held 0.823s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:45 devstack sudo[96551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:45 devstack sudo[96551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Created reservations ['4c62e9d7-b662-4a0e-8fb8-aa210e07e837', '533a76e9-8ae4-4f31-a22e-bb89e3417f37', '356b867a-491c-4a96-8eff-587564fdb011', '68fdb172-9f83-4ed2-8279-bbd38f84d9df'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:45 devstack sudo[96548]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.435s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:45 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Deleted volume successfully. Sep 04 19:10:45 devstack sudo[96554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:45 devstack sudo[96554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1ad360a8-b8db-4453-b8cc-32a5735d1e24 tempest-VolumesGetTest-1894119627 None] Lock "cinder-17f9d43c-ad40-4ee3-9b15-edc9760798a7-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Acquiring lock "cinder-44791a8d-f4f8-4330-98a5-e4a6d80005e3-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Lock "cinder-44791a8d-f4f8-4330-98a5-e4a6d80005e3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Acquiring lock "cinder-quobyte-44791a8d-f4f8-4330-98a5-e4a6d80005e3" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Lock "cinder-quobyte-44791a8d-f4f8-4330-98a5-e4a6d80005e3" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:45 devstack sudo[96551]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.455s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[77763de2-3b69-4022-9499-e8d44241b119]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44791a8d-f4f8-4330-98a5-e4a6d80005e3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:45 devstack sudo[96554]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.386s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:45 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Deleted volume successfully. Sep 04 19:10:45 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44791a8d-f4f8-4330-98a5-e4a6d80005e3 Sep 04 19:10:45 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cfa64541-2002-4bb8-83ec-56b2ce4352f6 tempest-ServersNegativeTestJSON-143013472 None] Lock "cinder-314ecd66-1979-4b40-8ae1-1aedcdcb883b-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Acquiring lock "cinder-c646f5aa-40af-4594-8751-0312f3fb627c-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "cinder-c646f5aa-40af-4594-8751-0312f3fb627c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Acquiring lock "cinder-quobyte-c646f5aa-40af-4594-8751-0312f3fb627c" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "cinder-quobyte-c646f5aa-40af-4594-8751-0312f3fb627c" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ad3ba6-3aff-4fd3-a900-5fde16915d65]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:46 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44791a8d-f4f8-4330-98a5-e4a6d80005e3" returned: 0 in 0.541s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44791a8d-f4f8-4330-98a5-e4a6d80005e3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:46 devstack sudo[96560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c Sep 04 19:10:46 devstack sudo[96560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:46 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44791a8d-f4f8-4330-98a5-e4a6d80005e3 Sep 04 19:10:46 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:46 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-44791a8d-f4f8-4330-98a5-e4a6d80005e3" returned: 0 in 0.399s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Lock "cinder-quobyte-44791a8d-f4f8-4330-98a5-e4a6d80005e3" released by "delete_volume" :: held 1.014s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:46 devstack sudo[96560]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c" returned: 0 in 0.564s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:46 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c Sep 04 19:10:46 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Flow 'volume_create_manager' (837163f0-6b48-4e84-a42d-02a66b3ed507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb574dc-c4f0-47d7-b543-9cf23a4396bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Created reservations ['a547bc86-4426-4fc0-b6ff-8390c6284c5e', 'f1123aa0-7f7a-4c40-8ac9-594c00f6b091', 'c2422b4f-351d-472d-b265-5592c0ae7119', '8475e307-46da-4413-8fdf-409ba0e5e5d9'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cb574dc-c4f0-47d7-b543-9cf23a4396bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1068990832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43933fc2-4f13-4692-9b7b-c7c84139a780,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='23f345ec7a02418fafa0bf1e24d1c6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:47Z,use_quota=True,user_id='c3dd474c4a824eee9d5584c075667b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b6e970-9360-4e09-8227-6a22bd1ef9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b6e970-9360-4e09-8227-6a22bd1ef9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c97f9cda-74d9-4c26-8125-544431e22a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:46 devstack sudo[96576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:46 devstack sudo[96576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:46 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c646f5aa-40af-4594-8751-0312f3fb627c" returned: 0 in 0.299s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "cinder-quobyte-c646f5aa-40af-4594-8751-0312f3fb627c" released by "delete_volume" :: held 0.977s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG cinder.quota [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Created reservations ['d091e709-3b1e-424f-a383-b3004296c175', '8a0f6281-b4dc-4ea2-bb4c-75e5b212ebe6', 'bac06b14-3517-444c-98f4-9e0edc85e532', '13514dd3-8f3e-4cdf-a326-d634c65a93cc'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:47 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:47 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:47 devstack sudo[96576]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.353s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Deleted volume successfully. Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4dc3846f-8231-46e8-b06e-b5c3f2d0f9e2 tempest-ServersNegativeTestJSON-143013472 None] Lock "cinder-44791a8d-f4f8-4330-98a5-e4a6d80005e3-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c97f9cda-74d9-4c26-8125-544431e22a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '43933fc2-4f13-4692-9b7b-c7c84139a780', 'volume_name': 'volume-43933fc2-4f13-4692-9b7b-c7c84139a780', 'volume_size': 1, 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd0ece6d722f24154ab955bf866d06cbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'created_at': datetime.datetime(2026, 9, 4, 16, 58, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 58, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e637b08c-391d-4edc-8402-9ba212deb71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5795e6-b1ea-4a87-b57a-4331338d3e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b5795e6-b1ea-4a87-b57a-4331338d3e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf42f6d-4df6-4d79-b1c2-12d18f678055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:47 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Volume 43933fc2-4f13-4692-9b7b-c7c84139a780: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-43933fc2-4f13-4692-9b7b-c7c84139a780', 'volume_size': 1, 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd0ece6d722f24154ab955bf866d06cbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'created_at': datetime.datetime(2026, 9, 4, 16, 58, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 58, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e637b08c-391d-4edc-8402-9ba212deb71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Trying to clone 43933fc2-4f13-4692-9b7b-c7c84139a780 from image e637b08c-391d-4edc-8402-9ba212deb71d at location (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 19:10:47 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.402s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG cinder.manager [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Deleted volume successfully. Sep 04 19:10:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-da54ee64-b1f9-49ed-9dcc-dd8597a5899a req-cc49c5f5-3e4d-455d-a95b-66c885beef27 tempest-VolumesSnapshotsTestJSON-1706701148 None] Lock "cinder-c646f5aa-40af-4594-8751-0312f3fb627c-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:48 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_r92l1pjxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 19:10:48 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Image download 20.69 MB at 20.69 MB/s Sep 04 19:10:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4b27b0-af5b-4717-a6b8-68150bc907a5]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_r92l1pjxdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:48 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_r92l1pjxdevstack@QuobyteHD Sep 04 19:10:48 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:49 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_r92l1pjxdevstack@QuobyteHD" returned: 0 in 0.771s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:49 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Temporary image e637b08c-391d-4edc-8402-9ba212deb71d is fetched for user c3dd474c4a824eee9d5584c075667b68. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 19:10:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3242908c-d0c1-4b87-ab36-2bcabcaf31fc]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_r92l1pjxdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:49 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_r92l1pjxdevstack@QuobyteHD Sep 04 19:10:49 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:49 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_r92l1pjxdevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1068990832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43933fc2-4f13-4692-9b7b-c7c84139a780,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='23f345ec7a02418fafa0bf1e24d1c6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:47Z,use_quota=True,user_id='c3dd474c4a824eee9d5584c075667b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:10:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Creating volume 43933fc2-4f13-4692-9b7b-c7c84139a780 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:10:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:10:49 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:10:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:49 devstack sudo[96632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780 1073741824 Sep 04 19:10:49 devstack sudo[96632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:50 devstack sudo[96632]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780 1073741824" returned: 0 in 0.738s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:50 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780 Sep 04 19:10:50 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:50 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780" returned: 0 in 0.306s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:10:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:50 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Attempting download of e637b08c-391d-4edc-8402-9ba212deb71d ((None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}])) to volume 43933fc2-4f13-4692-9b7b-c7c84139a780. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 19:10:50 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[07704ef3-43e5-436a-b6ee-535b3984e978]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_aggqox09 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:51 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_aggqox09 Sep 04 19:10:51 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:51 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_aggqox09" returned: 0 in 0.370s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_aggqox09 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:51 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_aggqox09 Sep 04 19:10:51 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:51 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_aggqox09" returned: 1 in 0.420s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_aggqox09' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:10:51 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[af31a038-430f-486d-b9e2-42a5eb32760d]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_r92l1pjxdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:51 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_r92l1pjxdevstack@QuobyteHD Sep 04 19:10:51 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:52 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_r92l1pjxdevstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:52 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] e637b08c-391d-4edc-8402-9ba212deb71d was qcow2, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 19:10:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_r92l1pjxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:52 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_r92l1pjxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780 Sep 04 19:10:52 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Flow 'volume_create_manager' (00dcc096-1f48-4d0a-a8c9-f08c32d728b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d17ade-4ac5-4bf5-8a46-5474dfa00441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d17ade-4ac5-4bf5-8a46-5474dfa00441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1054377705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07f76f85-7d33-4819-b971-7c033f4c1b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba67e432ed0c475a97cb2a75f953a0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:54Z,use_quota=True,user_id='9d58204cfb5e46eea1c45aa9987cb584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb17a97b-d655-48f8-adf4-4b01ae57b413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb17a97b-d655-48f8-adf4-4b01ae57b413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63084dc-7a53-4eff-80c2-6d93ac04154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e63084dc-7a53-4eff-80c2-6d93ac04154a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07f76f85-7d33-4819-b971-7c033f4c1b83', 'volume_name': 'volume-07f76f85-7d33-4819-b971-7c033f4c1b83', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c445449-01ce-42f2-8557-b81880c0f451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c445449-01ce-42f2-8557-b81880c0f451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e9094b-8c49-4723-a952-195a41b0f68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:54 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Volume 07f76f85-7d33-4819-b971-7c033f4c1b83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07f76f85-7d33-4819-b971-7c033f4c1b83', 'volume_size': 1} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1054377705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07f76f85-7d33-4819-b971-7c033f4c1b83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba67e432ed0c475a97cb2a75f953a0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:54Z,use_quota=True,user_id='9d58204cfb5e46eea1c45aa9987cb584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Creating volume 07f76f85-7d33-4819-b971-7c033f4c1b83 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:10:54 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-07f76f85-7d33-4819-b971-7c033f4c1b83 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:54 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-07f76f85-7d33-4819-b971-7c033f4c1b83 1073741824 Sep 04 19:10:54 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:54 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_r92l1pjxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780" returned: 0 in 2.500s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_r92l1pjxdevstack@QuobyteHD, size 112.00 MB, duration 2.50 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:10:54 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Converted 112.00 MB image at 44.78 MB/s Sep 04 19:10:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:54 devstack sudo[96669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780 1G Sep 04 19:10:54 devstack sudo[96669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:55 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-07f76f85-7d33-4819-b971-7c033f4c1b83 1073741824" returned: 0 in 0.576s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-07f76f85-7d33-4819-b971-7c033f4c1b83 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:55 devstack sudo[96669]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780 1G" returned: 0 in 0.414s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Downloaded image e637b08c-391d-4edc-8402-9ba212deb71d ((None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}])) to volume 43933fc2-4f13-4692-9b7b-c7c84139a780 successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Temporary image e637b08c-391d-4edc-8402-9ba212deb71d for user c3dd474c4a824eee9d5584c075667b68 is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Marking volume 43933fc2-4f13-4692-9b7b-c7c84139a780 as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Copying metadata from image e637b08c-391d-4edc-8402-9ba212deb71d to 43933fc2-4f13-4692-9b7b-c7c84139a780. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Creating volume glance metadata for volume 43933fc2-4f13-4692-9b7b-c7c84139a780 backed by image e637b08c-391d-4edc-8402-9ba212deb71d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 19:10:55 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-07f76f85-7d33-4819-b971-7c033f4c1b83 Sep 04 19:10:55 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bf42f6d-4df6-4d79-b1c2-12d18f678055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43933fc2-4f13-4692-9b7b-c7c84139a780', 'volume_size': 1, 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd0ece6d722f24154ab955bf866d06cbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'created_at': datetime.datetime(2026, 9, 4, 16, 58, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 58, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e637b08c-391d-4edc-8402-9ba212deb71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8ed67a-4e12-4419-899f-3ba7f7f4ce23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:55 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Volume volume-43933fc2-4f13-4692-9b7b-c7c84139a780 (43933fc2-4f13-4692-9b7b-c7c84139a780): created successfully Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8ed67a-4e12-4419-899f-3ba7f7f4ce23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Flow 'volume_create_manager' (837163f0-6b48-4e84-a42d-02a66b3ed507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-713d8688-1564-4408-ae25-1f6394c5a038 tempest-VolumesGetTest-1894119627 None] Created volume successfully. Sep 04 19:10:55 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-07f76f85-7d33-4819-b971-7c033f4c1b83" returned: 0 in 0.305s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e9094b-8c49-4723-a952-195a41b0f68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07f76f85-7d33-4819-b971-7c033f4c1b83', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1548a9b6-2f83-4d7d-928e-32f1d1328305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:55 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Volume volume-07f76f85-7d33-4819-b971-7c033f4c1b83 (07f76f85-7d33-4819-b971-7c033f4c1b83): created successfully Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1548a9b6-2f83-4d7d-928e-32f1d1328305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Flow 'volume_create_manager' (00dcc096-1f48-4d0a-a8c9-f08c32d728b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-97c92914-e9e8-47e2-8b50-278727df1ef6 tempest-VolumeQuotasAdminTestJSON-223392111 None] Created volume successfully. Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Acquiring lock "cinder-07f76f85-7d33-4819-b971-7c033f4c1b83-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Lock "cinder-07f76f85-7d33-4819-b971-7c033f4c1b83-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Flow 'volume_create_manager' (b54ac030-d67f-4943-9673-0f7317059de3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59b05f9-e76c-46eb-b8d8-1bb87863275b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d59b05f9-e76c-46eb-b8d8-1bb87863275b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1273926490',display_name='tempest-VolumesGetTest-Volume-2135367675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d2bb51-5a4e-4052-8e2d-d5929047347e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f345ec7a02418fafa0bf1e24d1c6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:56Z,use_quota=True,user_id='c3dd474c4a824eee9d5584c075667b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b38d55-e0ad-4c94-8ad6-da90be112242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b38d55-e0ad-4c94-8ad6-da90be112242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d8686b-5110-48b3-9a8e-2d250c756139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d8686b-5110-48b3-9a8e-2d250c756139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8d2bb51-5a4e-4052-8e2d-d5929047347e', 'volume_name': 'volume-e8d2bb51-5a4e-4052-8e2d-d5929047347e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3262547d-aa17-490f-af38-06d91535ea4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3262547d-aa17-490f-af38-06d91535ea4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22daed9-0563-42f1-a97a-2b6045c06db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:56 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Volume e8d2bb51-5a4e-4052-8e2d-d5929047347e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8d2bb51-5a4e-4052-8e2d-d5929047347e', 'volume_size': 1} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1273926490',display_name='tempest-VolumesGetTest-Volume-2135367675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d2bb51-5a4e-4052-8e2d-d5929047347e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23f345ec7a02418fafa0bf1e24d1c6f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:56Z,use_quota=True,user_id='c3dd474c4a824eee9d5584c075667b68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Creating volume e8d2bb51-5a4e-4052-8e2d-d5929047347e {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:10:56 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e8d2bb51-5a4e-4052-8e2d-d5929047347e 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:56 devstack sudo[96682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e8d2bb51-5a4e-4052-8e2d-d5929047347e 1073741824 Sep 04 19:10:56 devstack sudo[96682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Acquiring lock "cinder-quobyte-07f76f85-7d33-4819-b971-7c033f4c1b83" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Lock "cinder-quobyte-07f76f85-7d33-4819-b971-7c033f4c1b83" acquired by "delete_volume" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3efa94-0666-4171-bb9f-d0fad92bb59b]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-07f76f85-7d33-4819-b971-7c033f4c1b83 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:56 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-07f76f85-7d33-4819-b971-7c033f4c1b83 Sep 04 19:10:56 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:57 devstack sudo[96682]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:57 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e8d2bb51-5a4e-4052-8e2d-d5929047347e 1073741824" returned: 0 in 0.572s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-07f76f85-7d33-4819-b971-7c033f4c1b83" returned: 0 in 0.455s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-07f76f85-7d33-4819-b971-7c033f4c1b83 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:57 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-07f76f85-7d33-4819-b971-7c033f4c1b83 Sep 04 19:10:57 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e8d2bb51-5a4e-4052-8e2d-d5929047347e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:57 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e8d2bb51-5a4e-4052-8e2d-d5929047347e Sep 04 19:10:57 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:57 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:57 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-07f76f85-7d33-4819-b971-7c033f4c1b83" returned: 0 in 0.407s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e8d2bb51-5a4e-4052-8e2d-d5929047347e" returned: 0 in 0.348s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Lock "cinder-quobyte-07f76f85-7d33-4819-b971-7c033f4c1b83" released by "delete_volume" :: held 0.932s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f22daed9-0563-42f1-a97a-2b6045c06db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8d2bb51-5a4e-4052-8e2d-d5929047347e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bad962e-bde4-4005-90a1-d9a56c0a76e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:57 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Volume volume-e8d2bb51-5a4e-4052-8e2d-d5929047347e (e8d2bb51-5a4e-4052-8e2d-d5929047347e): created successfully Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bad962e-bde4-4005-90a1-d9a56c0a76e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Flow 'volume_create_manager' (b54ac030-d67f-4943-9673-0f7317059de3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-714169b7-3a02-444f-9e52-4da7a632b073 tempest-VolumesGetTest-1894119627 None] Created volume successfully. Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Created reservations ['b70f6c0a-0f2b-4789-8102-144860100dc4', '8d8919e4-bb69-4115-b41d-aa008716e153', '1a476e9b-958d-47f2-bd75-73187697d931', 'f365a7b8-5ac2-4194-a62f-c8ba21b90510'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:57 devstack sudo[96699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:57 devstack sudo[96699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:58 devstack sudo[96699]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.289s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:58 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:10:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Deleted volume successfully. Sep 04 19:10:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-432489df-8509-4dce-afb5-bfba6c8f5af2 tempest-VolumeQuotasAdminTestJSON-223392111 None] Lock "cinder-07f76f85-7d33-4819-b971-7c033f4c1b83-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Acquiring lock "cinder-e8d2bb51-5a4e-4052-8e2d-d5929047347e-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Lock "cinder-e8d2bb51-5a4e-4052-8e2d-d5929047347e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Acquiring lock "cinder-quobyte-e8d2bb51-5a4e-4052-8e2d-d5929047347e" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:10:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-e8d2bb51-5a4e-4052-8e2d-d5929047347e" acquired by "delete_volume" :: waited 0.038s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:10:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd15bb07-bcea-4044-bb7a-a1402ae055ce]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:10:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e8d2bb51-5a4e-4052-8e2d-d5929047347e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:59 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e8d2bb51-5a4e-4052-8e2d-d5929047347e Sep 04 19:10:59 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:59 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e8d2bb51-5a4e-4052-8e2d-d5929047347e" returned: 0 in 0.571s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e8d2bb51-5a4e-4052-8e2d-d5929047347e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:10:59 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e8d2bb51-5a4e-4052-8e2d-d5929047347e Sep 04 19:10:59 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Flow 'volume_create_manager' (635b619a-d478-43b8-88d6-817d44760da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e564e380-f8aa-4ca9-a9c6-4724891e36cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e564e380-f8aa-4ca9-a9c6-4724891e36cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1974100252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0812c5-4417-4d29-bbbd-02888c389729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba67e432ed0c475a97cb2a75f953a0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:59Z,use_quota=True,user_id='9d58204cfb5e46eea1c45aa9987cb584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde63d1e-9101-4bb9-a45e-9b25915dbe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde63d1e-9101-4bb9-a45e-9b25915dbe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5bf7ddb-c7a8-458a-bba0-fec3a5bf647e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5bf7ddb-c7a8-458a-bba0-fec3a5bf647e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c0812c5-4417-4d29-bbbd-02888c389729', 'volume_name': 'volume-0c0812c5-4417-4d29-bbbd-02888c389729', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dcf4a4-f43f-464a-a1d4-f6ce80b179e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6dcf4a4-f43f-464a-a1d4-f6ce80b179e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd3e5a4-6f24-41b8-98e1-e8a23c856065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:10:59 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Volume 0c0812c5-4417-4d29-bbbd-02888c389729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c0812c5-4417-4d29-bbbd-02888c389729', 'volume_size': 1} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:10:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1974100252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0812c5-4417-4d29-bbbd-02888c389729,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba67e432ed0c475a97cb2a75f953a0a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:10:59Z,use_quota=True,user_id='9d58204cfb5e46eea1c45aa9987cb584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Creating volume 0c0812c5-4417-4d29-bbbd-02888c389729 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:10:59 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0c0812c5-4417-4d29-bbbd-02888c389729 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:59 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0c0812c5-4417-4d29-bbbd-02888c389729 1073741824 Sep 04 19:10:59 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:10:59 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e8d2bb51-5a4e-4052-8e2d-d5929047347e" returned: 0 in 0.310s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-e8d2bb51-5a4e-4052-8e2d-d5929047347e" released by "delete_volume" :: held 0.937s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Created reservations ['c1b845bb-6858-4bbd-896d-dce40dbc1662', '603f9920-c97f-44e7-a9fa-9068cf4101fd', '315d05fb-64f4-4dc2-a34c-a88bbb076b45', 'b611ad88-374f-4e58-aeba-508317c68c87'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:10:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:10:59 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:10:59 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:00 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0c0812c5-4417-4d29-bbbd-02888c389729 1073741824" returned: 0 in 0.610s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:00 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0c0812c5-4417-4d29-bbbd-02888c389729 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.292s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:00 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:11:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Deleted volume successfully. Sep 04 19:11:00 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0c0812c5-4417-4d29-bbbd-02888c389729 Sep 04 19:11:00 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-79e66374-a607-4aa3-8acc-b915a34aa5d6 tempest-VolumesGetTest-1894119627 None] Lock "cinder-e8d2bb51-5a4e-4052-8e2d-d5929047347e-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:11:00 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0c0812c5-4417-4d29-bbbd-02888c389729" returned: 0 in 0.288s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:11:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd3e5a4-6f24-41b8-98e1-e8a23c856065) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c0812c5-4417-4d29-bbbd-02888c389729', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7412266-1ab4-41e6-b6fc-e00419e408b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:00 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Volume volume-0c0812c5-4417-4d29-bbbd-02888c389729 (0c0812c5-4417-4d29-bbbd-02888c389729): created successfully Sep 04 19:11:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7412266-1ab4-41e6-b6fc-e00419e408b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Flow 'volume_create_manager' (635b619a-d478-43b8-88d6-817d44760da8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:11:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-049b5a86-1d67-46dc-a6ce-a33c75ed784b tempest-VolumeQuotasAdminTestJSON-223392111 None] Created volume successfully. Sep 04 19:11:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-bf690198-6cda-4cb2-927c-2500c1b90d84 tempest-GroupsV314Test-295202782 None] Group tempest-GroupsV314Test-Group-1143346620: creating Sep 04 19:11:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-bf690198-6cda-4cb2-927c-2500c1b90d84 tempest-GroupsV314Test-295202782 None] Group tempest-GroupsV314Test-Group-1143346620: created successfully Sep 04 19:11:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-bf690198-6cda-4cb2-927c-2500c1b90d84 tempest-GroupsV314Test-295202782 None] Create group completed successfully. Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Acquiring lock "cinder-43933fc2-4f13-4692-9b7b-c7c84139a780-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Lock "cinder-43933fc2-4f13-4692-9b7b-c7c84139a780-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Acquiring lock "cinder-quobyte-43933fc2-4f13-4692-9b7b-c7c84139a780" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Flow 'volume_create_manager' (76c22374-86a4-4e05-9bcb-34454df188f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf769b7-0dfe-4801-af8a-5b12e6ca1b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-43933fc2-4f13-4692-9b7b-c7c84139a780" acquired by "delete_volume" :: waited 0.046s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf769b7-0dfe-4801-af8a-5b12e6ca1b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1544616218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34176f2-6082-4b17-b4c2-4f26e4b991c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='608d5eacf79648dca92511a6df156b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:11:01Z,use_quota=True,user_id='4f75699abb5a4491aab6ead7d7eaf92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7232197b-9309-431c-993e-cb9b80d9b9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7232197b-9309-431c-993e-cb9b80d9b9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfefadd-3fa9-4b8f-8894-390526a7e91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8dfefadd-3fa9-4b8f-8894-390526a7e91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd34176f2-6082-4b17-b4c2-4f26e4b991c6', 'volume_name': 'volume-d34176f2-6082-4b17-b4c2-4f26e4b991c6', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d966aad3-3e23-4cc3-b0a8-5862e1a2b2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d966aad3-3e23-4cc3-b0a8-5862e1a2b2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16864d62-0911-429c-b952-8a099b521613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:01 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Volume d34176f2-6082-4b17-b4c2-4f26e4b991c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d34176f2-6082-4b17-b4c2-4f26e4b991c6', 'volume_size': 1} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1544616218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34176f2-6082-4b17-b4c2-4f26e4b991c6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='608d5eacf79648dca92511a6df156b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:11:01Z,use_quota=True,user_id='4f75699abb5a4491aab6ead7d7eaf92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Creating volume d34176f2-6082-4b17-b4c2-4f26e4b991c6 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:11:01 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d34176f2-6082-4b17-b4c2-4f26e4b991c6 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b4f6a7-b31d-4ca1-8f0f-ecb90b892462]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:01 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d34176f2-6082-4b17-b4c2-4f26e4b991c6 1073741824 Sep 04 19:11:01 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:01 devstack sudo[96726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780 Sep 04 19:11:01 devstack sudo[96726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:01 devstack sudo[96726]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780" returned: 0 in 0.417s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:01 devstack sudo[96735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780 Sep 04 19:11:01 devstack sudo[96735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:01 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d34176f2-6082-4b17-b4c2-4f26e4b991c6 1073741824" returned: 0 in 0.476s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d34176f2-6082-4b17-b4c2-4f26e4b991c6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:01 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d34176f2-6082-4b17-b4c2-4f26e4b991c6 Sep 04 19:11:01 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:01 devstack sudo[96735]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-43933fc2-4f13-4692-9b7b-c7c84139a780" returned: 0 in 0.267s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Lock "cinder-quobyte-43933fc2-4f13-4692-9b7b-c7c84139a780" released by "delete_volume" :: held 0.801s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:11:02 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Created reservations ['63b2e2d0-9809-4226-9f5a-e75779176866', '3a1f48ec-13ef-4055-a5d7-0c608b4b7543', '083c6df3-7bae-48a5-9bba-59d520ec554b', '4d91b52b-1405-4eee-b7ba-79cda94143ce'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d34176f2-6082-4b17-b4c2-4f26e4b991c6" returned: 0 in 0.297s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] <== create_volume: return (812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16864d62-0911-429c-b952-8a099b521613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34176f2-6082-4b17-b4c2-4f26e4b991c6', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37aace46-f23f-4aee-b078-3b448395cdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:02 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Volume volume-d34176f2-6082-4b17-b4c2-4f26e4b991c6 (d34176f2-6082-4b17-b4c2-4f26e4b991c6): created successfully Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37aace46-f23f-4aee-b078-3b448395cdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Flow 'volume_create_manager' (76c22374-86a4-4e05-9bcb-34454df188f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:11:02 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a1eb3412-8eca-4049-8cc2-0db795dcd7d3 tempest-VolumesTestJSON-1943234307 None] Created volume successfully. Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:02 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:11:02 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:02 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-beb16a11-a8f5-4530-bd92-c7f628578883 tempest-VolumeQuotasAdminTestJSON-880807674 None] Transfer volume completed successfully. Sep 04 19:11:02 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.266s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:11:02 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Deleted volume successfully. Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0017c10c-c816-4ee5-8ffb-26247df3239c tempest-VolumesGetTest-1894119627 None] Lock "cinder-43933fc2-4f13-4692-9b7b-c7c84139a780-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Flow 'volume_create_manager' (e741b081-e18c-49cd-a4bd-ccbd8b2a6f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6143efa5-f37b-4945-a582-c1dd692543c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6143efa5-f37b-4945-a582-c1dd692543c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615287797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0fa80242-5eaf-41e6-97c3-bb3d55b1c17e,host='devstack@QuobyteHD#QuobyteHD',id=f25b505e-7b42-4834-aa48-9a4becc0f4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d77f7cffcd54908a814a7c68d2d3575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:11:03Z,use_quota=True,user_id='6d96b8cc4d41403584702420ac0cfe8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cba748-af1d-41d9-ad87-72da17966f0c),volume_type_id=a1cba748-af1d-41d9-ad87-72da17966f0c)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46da5ffc-479d-44b3-abed-3952f02f3f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46da5ffc-479d-44b3-abed-3952f02f3f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36484d63-38bb-43fe-86f9-7fb906d72012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36484d63-38bb-43fe-86f9-7fb906d72012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f25b505e-7b42-4834-aa48-9a4becc0f4d9', 'volume_name': 'volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaed58e3-b22d-4e8d-b370-8a0c84adefe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaed58e3-b22d-4e8d-b370-8a0c84adefe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686dafac-4d68-4b9b-99ca-452f49755150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:02 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Volume f25b505e-7b42-4834-aa48-9a4becc0f4d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9', 'volume_size': 1} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0fa80242-5eaf-41e6-97c3-bb3d55b1c17e,created_at=2026-09-04T17:11:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-615287797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0fa80242-5eaf-41e6-97c3-bb3d55b1c17e,host='devstack@QuobyteHD#QuobyteHD',id=f25b505e-7b42-4834-aa48-9a4becc0f4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d77f7cffcd54908a814a7c68d2d3575',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:11:03Z,use_quota=True,user_id='6d96b8cc4d41403584702420ac0cfe8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1cba748-af1d-41d9-ad87-72da17966f0c),volume_type_id=a1cba748-af1d-41d9-ad87-72da17966f0c)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Creating volume f25b505e-7b42-4834-aa48-9a4becc0f4d9 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:11:02 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:11:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:02 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 1073741824 Sep 04 19:11:02 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Acquiring lock "cinder-0c0812c5-4417-4d29-bbbd-02888c389729-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Lock "cinder-0c0812c5-4417-4d29-bbbd-02888c389729-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Acquiring lock "cinder-quobyte-0c0812c5-4417-4d29-bbbd-02888c389729" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Lock "cinder-quobyte-0c0812c5-4417-4d29-bbbd-02888c389729" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2750b4d3-356f-465a-ab33-010571188059]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0c0812c5-4417-4d29-bbbd-02888c389729 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:03 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0c0812c5-4417-4d29-bbbd-02888c389729 Sep 04 19:11:03 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:03 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 1073741824" returned: 0 in 0.675s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Flow 'volume_create_manager' (b945277a-a769-468e-ae8c-1098582de1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be0c024e-e66f-429a-ad9a-561cdb71e860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be0c024e-e66f-429a-ad9a-561cdb71e860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1765655129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed5c3c2-3199-4735-84e0-8d7450f00ff9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='608d5eacf79648dca92511a6df156b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:11:03Z,use_quota=True,user_id='4f75699abb5a4491aab6ead7d7eaf92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f53c11-cd65-4f8a-b81b-e0caa2a0d882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f53c11-cd65-4f8a-b81b-e0caa2a0d882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ee6881-bbd4-4ce1-b55c-73812fe7bcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c2ee6881-bbd4-4ce1-b55c-73812fe7bcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ed5c3c2-3199-4735-84e0-8d7450f00ff9', 'volume_name': 'volume-5ed5c3c2-3199-4735-84e0-8d7450f00ff9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73805b83-0ca6-4feb-851b-07588a19b799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73805b83-0ca6-4feb-851b-07588a19b799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c812f70-f4f4-43cf-af06-e1705e1bfebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:03 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Volume 5ed5c3c2-3199-4735-84e0-8d7450f00ff9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ed5c3c2-3199-4735-84e0-8d7450f00ff9', 'volume_size': 1} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:03 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0c0812c5-4417-4d29-bbbd-02888c389729" returned: 0 in 0.447s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0c0812c5-4417-4d29-bbbd-02888c389729 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:03 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 Sep 04 19:11:03 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:03 devstack sudo[96757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0c0812c5-4417-4d29-bbbd-02888c389729 Sep 04 19:11:03 devstack sudo[96757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:03 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9" returned: 0 in 0.327s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.350s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:11:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1765655129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed5c3c2-3199-4735-84e0-8d7450f00ff9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='608d5eacf79648dca92511a6df156b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:11:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:11:03Z,use_quota=True,user_id='4f75699abb5a4491aab6ead7d7eaf92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Creating volume 5ed5c3c2-3199-4735-84e0-8d7450f00ff9 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:11:04 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5ed5c3c2-3199-4735-84e0-8d7450f00ff9 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:04 devstack sudo[96757]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (686dafac-4d68-4b9b-99ca-452f49755150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550855e1-8e7d-48b1-b4e6-9fb8ff78f79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:04 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5ed5c3c2-3199-4735-84e0-8d7450f00ff9 1073741824 Sep 04 19:11:04 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0c0812c5-4417-4d29-bbbd-02888c389729" returned: 0 in 0.396s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Lock "cinder-quobyte-0c0812c5-4417-4d29-bbbd-02888c389729" released by "delete_volume" :: held 0.907s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:11:04 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Volume volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 (f25b505e-7b42-4834-aa48-9a4becc0f4d9): created successfully Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (550855e1-8e7d-48b1-b4e6-9fb8ff78f79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Flow 'volume_create_manager' (e741b081-e18c-49cd-a4bd-ccbd8b2a6f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:11:04 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-24367d8d-4243-4845-ba6d-050f92d9ac6a tempest-GroupsV314Test-295202782 None] Created volume successfully. Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Created reservations ['e242f256-7970-4529-a731-d0ec763786be', '19e74df3-b802-444b-bac8-4ac9b8d9025d', '08e02708-9820-4d7d-b7d6-b63646e376fa', '0bb1730b-30fb-434f-be52-9add53b36f8c'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:04 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:11:04 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:04 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.296s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:11:04 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5ed5c3c2-3199-4735-84e0-8d7450f00ff9 1073741824" returned: 0 in 0.547s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:04 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Deleted volume successfully. Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-16611e4a-1022-402a-a57c-539cdc0c3cc5 tempest-VolumeQuotasAdminTestJSON-2107440227 None] Lock "cinder-0c0812c5-4417-4d29-bbbd-02888c389729-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5ed5c3c2-3199-4735-84e0-8d7450f00ff9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:04 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5ed5c3c2-3199-4735-84e0-8d7450f00ff9 Sep 04 19:11:04 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:04 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5ed5c3c2-3199-4735-84e0-8d7450f00ff9" returned: 0 in 0.235s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c812f70-f4f4-43cf-af06-e1705e1bfebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ed5c3c2-3199-4735-84e0-8d7450f00ff9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75bc4740-ca47-455a-9704-309625f97d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:04 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Volume volume-5ed5c3c2-3199-4735-84e0-8d7450f00ff9 (5ed5c3c2-3199-4735-84e0-8d7450f00ff9): created successfully Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75bc4740-ca47-455a-9704-309625f97d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Flow 'volume_create_manager' (b945277a-a769-468e-ae8c-1098582de1b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:11:04 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5708455e-1d36-4a31-9611-dc7a709359d5 tempest-VolumesTestJSON-1943234307 None] Created volume successfully. Sep 04 19:11:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:05 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Cloning volume f25b505e-7b42-4834-aa48-9a4becc0f4d9 to volume abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4 Sep 04 19:11:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Creating offline snapshot 78d58f63-782f-4d0a-8a56-425b1614dd73 of volume f25b505e-7b42-4834-aa48-9a4becc0f4d9 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:11:05 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c1cc73-5ce7-4ce5-84e7-65ea7690a679]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:11:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:06 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 Sep 04 19:11:06 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:06 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9" returned: 0 in 0.485s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:06 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 1G Sep 04 19:11:06 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:06 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:11:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Flow 'volume_create_manager' (1c833185-5b5a-4c20-9580-1e48d8ebafb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:11:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b956315d-70f4-4ea5-a719-16c811659aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b956315d-70f4-4ea5-a719-16c811659aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1712924048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a233167-9b84-46c3-ac15-82115254c49d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='608d5eacf79648dca92511a6df156b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:11:07Z,use_quota=True,user_id='4f75699abb5a4491aab6ead7d7eaf92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078dcb8a-2964-4ed5-b31a-df572c356e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (078dcb8a-2964-4ed5-b31a-df572c356e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b08b27-9042-4834-b386-bfe7a88670ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48b08b27-9042-4834-b386-bfe7a88670ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a233167-9b84-46c3-ac15-82115254c49d', 'volume_name': 'volume-8a233167-9b84-46c3-ac15-82115254c49d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d180a8f1-3377-4a6f-863e-1ec3cf5b59e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d180a8f1-3377-4a6f-863e-1ec3cf5b59e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d0b41c-a7fe-4137-8c80-b759cf81f766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:06 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Volume 8a233167-9b84-46c3-ac15-82115254c49d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a233167-9b84-46c3-ac15-82115254c49d', 'volume_size': 1} Sep 04 19:11:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:07 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 1G" returned: 0 in 0.592s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:07 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 Sep 04 19:11:07 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:07 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73" returned: 0 in 0.329s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:07 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 19:11:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:07 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 Sep 04 19:11:07 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:07 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73" returned: 0 in 0.352s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:07 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.info Sep 04 19:11:07 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:08 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.info" returned: 0 in 0.300s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:08 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 04 19:11:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:08 devstack sudo[96800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.info Sep 04 19:11:08 devstack sudo[96800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:08 devstack sudo[96800]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.info" returned: 0 in 0.303s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Acquiring lock "cinder-quobyte-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:11:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Lock "cinder-quobyte-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:11:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] snapshot: 78d58f63-782f-4d0a-8a56-425b1614dd73, volume: abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 19:11:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:11:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:11:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:08 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab6795f-af84-4e76-ab9d-cd909a88aeb5]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:11:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:08 devstack sudo[96803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 Sep 04 19:11:08 devstack sudo[96803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:08 devstack sudo[96803]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73" returned: 0 in 0.495s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:11:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4f0caa-12d5-400d-95a2-aaf9d9a65148]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:11:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:09 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 Sep 04 19:11:09 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:09 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9" returned: 0 in 0.423s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 19:11:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 19:11:09 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Path /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4 not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 19:11:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:09 devstack sudo[96813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4 Sep 04 19:11:09 devstack sudo[96813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:15 devstack sudo[96813]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4" returned: 0 in 6.051s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:15 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9, size 1024.00 MB, duration 6.05 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:11:15 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Converted 1024.00 MB image at 169.20 MB/s Sep 04 19:11:15 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4 is being set with open permissions: ugo+rw: NotImplementedError Sep 04 19:11:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:15 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4 Sep 04 19:11:15 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:15 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4" returned: 0 in 0.388s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Lock "cinder-quobyte-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4" released by "_copy_volume_from_snapshot" :: held 7.449s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:11:15 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=185,cinder:SELECT=132,cinder:DELETE=15,cinder:INSERT=54 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:11:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Acquiring lock "cinder-quobyte-78d58f63-782f-4d0a-8a56-425b1614dd73" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:11:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Lock "cinder-quobyte-78d58f63-782f-4d0a-8a56-425b1614dd73" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:11:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Deleting offline snapshot 78d58f63-782f-4d0a-8a56-425b1614dd73 of volume f25b505e-7b42-4834-aa48-9a4becc0f4d9 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:11:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] snapshot_file for this snap is: volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:11:16 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bb72d8-98fb-467a-8a2f-6836c6161fc7]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:11:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:16 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 Sep 04 19:11:16 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:16 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73" returned: 0 in 0.511s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:11:16 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dff5c5-f446-4017-9ca1-c4e27bae9790]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:11:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:16 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 Sep 04 19:11:16 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:17 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9" returned: 0 in 0.677s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:17 devstack sudo[96840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 Sep 04 19:11:17 devstack sudo[96840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:17 devstack sudo[96840]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73" returned: 0 in 0.414s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:17 devstack sudo[96846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73 Sep 04 19:11:17 devstack sudo[96846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:17 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=142,cinder:INSERT=47,cinder:UPDATE=185,cinder:DELETE=17 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:11:17 devstack sudo[96846]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9.78d58f63-782f-4d0a-8a56-425b1614dd73" returned: 0 in 0.273s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Lock "cinder-quobyte-78d58f63-782f-4d0a-8a56-425b1614dd73" released by "_delete_snapshot" :: held 2.038s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.150s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.161s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1712924048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a233167-9b84-46c3-ac15-82115254c49d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='608d5eacf79648dca92511a6df156b83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:11:07Z,use_quota=True,user_id='4f75699abb5a4491aab6ead7d7eaf92f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Creating volume 8a233167-9b84-46c3-ac15-82115254c49d {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:11:18 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a233167-9b84-46c3-ac15-82115254c49d 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:18 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a233167-9b84-46c3-ac15-82115254c49d 1073741824 Sep 04 19:11:18 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-21c99770-7e61-4c1b-930b-251735563472 tempest-GroupsV314Test-295202782 None] Create group from source-group-0fa80242-5eaf-41e6-97c3-bb3d55b1c17e completed successfully. Sep 04 19:11:18 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a233167-9b84-46c3-ac15-82115254c49d 1073741824" returned: 0 in 0.547s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a233167-9b84-46c3-ac15-82115254c49d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:18 devstack sudo[96855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a233167-9b84-46c3-ac15-82115254c49d Sep 04 19:11:18 devstack sudo[96855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:18 devstack sudo[96855]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a233167-9b84-46c3-ac15-82115254c49d" returned: 0 in 0.337s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9d0b41c-a7fe-4137-8c80-b759cf81f766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a233167-9b84-46c3-ac15-82115254c49d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73040021-e489-4de2-8f7d-73b68ba959e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:19 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Volume volume-8a233167-9b84-46c3-ac15-82115254c49d (8a233167-9b84-46c3-ac15-82115254c49d): created successfully Sep 04 19:11:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73040021-e489-4de2-8f7d-73b68ba959e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Flow 'volume_create_manager' (1c833185-5b5a-4c20-9580-1e48d8ebafb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:11:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-cdf726a0-6fb9-404d-9ee5-00d7fdec2809 tempest-VolumesTestJSON-1943234307 None] Created volume successfully. Sep 04 19:11:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Acquiring lock "cinder-quobyte-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:11:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Lock "cinder-quobyte-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:11:19 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[34081d99-f14f-4b08-88fd-aa545c0bb151]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:11:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:20 devstack sudo[96858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4 Sep 04 19:11:20 devstack sudo[96858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:20 devstack sudo[96858]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4" returned: 0 in 0.521s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:20 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4 Sep 04 19:11:20 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:20 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4" returned: 0 in 0.338s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Lock "cinder-quobyte-abe2ecfe-c12c-44cd-aaab-6edcc6abd8e4" released by "delete_volume" :: held 0.924s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:11:20 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Created reservations ['d1e8fb4f-77cc-422e-9c4a-836706abc231'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:11:20 devstack cinder-volume[87560]: WARNING cinder.quota [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-531918602 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-531918602, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:11:20 devstack cinder-volume[87560]: WARNING cinder.quota [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-531918602 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-531918602, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:11:20 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Created reservations ['9a28b176-c20e-4968-b375-db14c86964ec', '2084502b-770e-4365-a1e1-549f9ee6a46c', '05ac47ff-b0be-4485-b54c-ad3aec865f57', '732ae7f7-f4d2-495f-97ac-f7c891e88525'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:21 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:11:21 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:21 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:11:21 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6025e8bf-7b7c-4995-a396-38bd3043e008 tempest-GroupsV314Test-295202782 None] Delete group completed successfully. Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] Acquiring lock "cinder-quobyte-f25b505e-7b42-4834-aa48-9a4becc0f4d9" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] Lock "cinder-quobyte-f25b505e-7b42-4834-aa48-9a4becc0f4d9" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[741bfbfb-75ce-4289-a375-c3571557c52e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Acquiring lock "cinder-8a233167-9b84-46c3-ac15-82115254c49d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Lock "cinder-8a233167-9b84-46c3-ac15-82115254c49d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Acquiring lock "cinder-quobyte-8a233167-9b84-46c3-ac15-82115254c49d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Lock "cinder-quobyte-8a233167-9b84-46c3-ac15-82115254c49d" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ec0223-1b2a-4c41-bd5b-ae77606dd77c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:11:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a233167-9b84-46c3-ac15-82115254c49d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:21 devstack sudo[96870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 Sep 04 19:11:21 devstack sudo[96870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:21 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a233167-9b84-46c3-ac15-82115254c49d Sep 04 19:11:21 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:22 devstack sudo[96870]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9" returned: 0 in 0.617s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:22 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a233167-9b84-46c3-ac15-82115254c49d" returned: 0 in 0.485s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a233167-9b84-46c3-ac15-82115254c49d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:22 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9 Sep 04 19:11:22 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:22 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a233167-9b84-46c3-ac15-82115254c49d Sep 04 19:11:22 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:22 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f25b505e-7b42-4834-aa48-9a4becc0f4d9" returned: 0 in 0.295s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] Lock "cinder-quobyte-f25b505e-7b42-4834-aa48-9a4becc0f4d9" released by "delete_volume" :: held 1.017s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:11:22 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a233167-9b84-46c3-ac15-82115254c49d" returned: 0 in 0.342s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Lock "cinder-quobyte-8a233167-9b84-46c3-ac15-82115254c49d" released by "delete_volume" :: held 0.877s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] Created reservations ['5aac0461-0e90-46aa-9238-241e54555e12'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Created reservations ['b23c7dd4-4c68-4fd7-acd3-68460fb5ebd2', '010a9b34-0de1-40ed-aacc-284658d57364', '804ec75c-ad0e-4b99-ab29-cdf2bac02473', '8033f346-9c6c-4c2e-a38c-bad5209c691c'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] Created reservations ['b668ea99-0845-4d86-a1e8-c1262db196ef', 'caaa9433-6997-4d07-9681-816fd21308d1', '360dd740-0948-4106-bfbd-c85debecdc23', 'b81d379e-ac35-42ed-b843-656206d30521'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:22 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:11:22 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Acquiring lock "cinder-5ed5c3c2-3199-4735-84e0-8d7450f00ff9-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Lock "cinder-5ed5c3c2-3199-4735-84e0-8d7450f00ff9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:23 devstack sudo[96889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:11:23 devstack sudo[96889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Acquiring lock "cinder-quobyte-5ed5c3c2-3199-4735-84e0-8d7450f00ff9" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Lock "cinder-quobyte-5ed5c3c2-3199-4735-84e0-8d7450f00ff9" acquired by "delete_volume" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb8f4ea-1b8f-47ad-bfcb-f0c2c8c3de06]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5ed5c3c2-3199-4735-84e0-8d7450f00ff9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:23 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.364s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:11:23 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Deleted volume successfully. Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6cfb2b07-f8a4-4a4d-9de9-20a2fe82d046 tempest-VolumesTestJSON-1943234307 None] Lock "cinder-8a233167-9b84-46c3-ac15-82115254c49d-delete_volume" released by "delete_volume" :: held 1.588s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:11:23 devstack sudo[96889]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.325s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:11:23 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5b687f9e-57df-4ef2-9ef2-a3aeb669562c tempest-GroupsV314Test-295202782 None] Delete group completed successfully. Sep 04 19:11:23 devstack sudo[96892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5ed5c3c2-3199-4735-84e0-8d7450f00ff9 Sep 04 19:11:23 devstack sudo[96892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:23 devstack sudo[96892]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5ed5c3c2-3199-4735-84e0-8d7450f00ff9" returned: 0 in 0.491s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5ed5c3c2-3199-4735-84e0-8d7450f00ff9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:23 devstack sudo[96898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5ed5c3c2-3199-4735-84e0-8d7450f00ff9 Sep 04 19:11:23 devstack sudo[96898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:24 devstack sudo[96898]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5ed5c3c2-3199-4735-84e0-8d7450f00ff9" returned: 0 in 0.305s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Lock "cinder-quobyte-5ed5c3c2-3199-4735-84e0-8d7450f00ff9" released by "delete_volume" :: held 0.870s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Created reservations ['43a7db35-f9b9-436d-b96e-c75813faa71e', '3770a773-6ed0-42a8-9279-52c399116311', '757b8907-496f-40fe-825f-550e71e2a330', 'bad001ce-dc6f-437e-b913-7bcba6d0c825'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:24 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:11:24 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Acquiring lock "cinder-d34176f2-6082-4b17-b4c2-4f26e4b991c6-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Lock "cinder-d34176f2-6082-4b17-b4c2-4f26e4b991c6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Acquiring lock "cinder-quobyte-d34176f2-6082-4b17-b4c2-4f26e4b991c6" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Lock "cinder-quobyte-d34176f2-6082-4b17-b4c2-4f26e4b991c6" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3f24d9-7c24-4e44-8609-6dc493d36e53]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d34176f2-6082-4b17-b4c2-4f26e4b991c6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:24 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.407s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:11:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Deleted volume successfully. Sep 04 19:11:24 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d34176f2-6082-4b17-b4c2-4f26e4b991c6 Sep 04 19:11:24 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee0c096d-888d-484b-8746-213b1ce5ca9f tempest-VolumesTestJSON-1943234307 None] Lock "cinder-5ed5c3c2-3199-4735-84e0-8d7450f00ff9-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:11:24 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d34176f2-6082-4b17-b4c2-4f26e4b991c6" returned: 0 in 0.490s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d34176f2-6082-4b17-b4c2-4f26e4b991c6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:25 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d34176f2-6082-4b17-b4c2-4f26e4b991c6 Sep 04 19:11:25 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:25 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d34176f2-6082-4b17-b4c2-4f26e4b991c6" returned: 0 in 0.471s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Lock "cinder-quobyte-d34176f2-6082-4b17-b4c2-4f26e4b991c6" released by "delete_volume" :: held 1.035s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:11:25 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Created reservations ['1399d258-ee17-48d8-88ec-021465f84a71', '0bc987cd-4c83-4378-a226-a3a01d275f61', 'beec6972-3024-46f3-b6a1-04cb96df1f8a', '20149530-9b3f-4456-a343-9845f2fb099b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:11:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:11:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:11:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:25 devstack sudo[96913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:11:25 devstack sudo[96913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:25 devstack sudo[96913]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.336s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:25 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:11:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Deleted volume successfully. Sep 04 19:11:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3b8d4daa-3d54-4709-82eb-477926fdd063 tempest-VolumesTestJSON-1943234307 None] Lock "cinder-d34176f2-6082-4b17-b4c2-4f26e4b991c6-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Flow 'volume_create_manager' (7a757673-bb18-4dbe-89c2-03a262e20514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c98840-8ca7-4e51-a180-b651982e723f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5c98840-8ca7-4e51-a180-b651982e723f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1793075877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2c18db-0596-4f76-944f-6075cbcdbaa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bc07a2a124479a990489f4a593f590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:11:34Z,use_quota=True,user_id='bbc24af75735445a8ef92854c49c1aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d945733b-dd14-47e2-974c-7a91feee8d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d945733b-dd14-47e2-974c-7a91feee8d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f292404-d708-49e9-b41f-4df0f3e9533e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f292404-d708-49e9-b41f-4df0f3e9533e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a2c18db-0596-4f76-944f-6075cbcdbaa6', 'volume_name': 'volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8f39be-3654-4446-a557-be60bc17ee3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8f39be-3654-4446-a557-be60bc17ee3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fad6fd-2639-44e3-9db7-2311b3a7957d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:33 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Volume 8a2c18db-0596-4f76-944f-6075cbcdbaa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6', 'volume_size': 1} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1793075877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2c18db-0596-4f76-944f-6075cbcdbaa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bc07a2a124479a990489f4a593f590',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:11:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:11:34Z,use_quota=True,user_id='bbc24af75735445a8ef92854c49c1aa3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Creating volume 8a2c18db-0596-4f76-944f-6075cbcdbaa6 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:11:33 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:11:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:33 devstack sudo[96953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 1073741824 Sep 04 19:11:33 devstack sudo[96953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:34 devstack sudo[96953]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 1073741824" returned: 0 in 0.671s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:34 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 Sep 04 19:11:34 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f433fcac-1a6a-437c-99f2-0868b6ba57ea tempest-BackendsCapabilitiesAdminTestsJSON-276056553 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7298393249512, 'free_capacity_gb': 1773.7298393249512, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87560) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 19:11:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5ec0eef7-e4d9-4485-9b55-e56d21e9908c tempest-BackendsCapabilitiesAdminTestsJSON-276056553 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7298393249512, 'free_capacity_gb': 1773.7298393249512, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87560) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 19:11:35 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6" returned: 0 in 0.346s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:11:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12fad6fd-2639-44e3-9db7-2311b3a7957d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541e6ded-746d-4633-ac5a-d7d82d5b56ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:35 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Volume volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 (8a2c18db-0596-4f76-944f-6075cbcdbaa6): created successfully Sep 04 19:11:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (541e6ded-746d-4633-ac5a-d7d82d5b56ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Flow 'volume_create_manager' (7a757673-bb18-4dbe-89c2-03a262e20514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:11:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4b5f9510-559e-40d5-97af-96844d6ea8e3 tempest-TestImageHashVerification-343030177 None] Created volume successfully. Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-736cd049-9b88-4547-b261-f8b11bb78219 tempest-TestImageHashVerification-343030177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-736cd049-9b88-4547-b261-f8b11bb78219 tempest-TestImageHashVerification-343030177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3e54cf-349c-43e9-bcd9-9cf9f5ebc7c2]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-736cd049-9b88-4547-b261-f8b11bb78219 tempest-TestImageHashVerification-343030177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:37 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 Sep 04 19:11:37 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:37 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-736cd049-9b88-4547-b261-f8b11bb78219 tempest-TestImageHashVerification-343030177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6" returned: 0 in 0.481s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9b4245-6f25-486f-892a-3b093b3cf879]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-736cd049-9b88-4547-b261-f8b11bb78219 tempest-TestImageHashVerification-343030177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Flow 'volume_create_manager' (f0ec1199-0fcf-404b-a356-c0caa6e147d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438d3963-cc34-435e-9970-f1a8c1e1ec07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (438d3963-cc34-435e-9970-f1a8c1e1ec07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1657848081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d4795d-55d0-4111-ac3f-3bbe7c904e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a447b4939549ffa93d5aee6619cb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:11:38Z,use_quota=True,user_id='b75443a0a07a40ee85e79d16ad33ed94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfb9193-e8e7-4d16-a498-2f2a167e7369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfb9193-e8e7-4d16-a498-2f2a167e7369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aca8bcd-6aae-405c-acd2-8fb1ecd5eecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4aca8bcd-6aae-405c-acd2-8fb1ecd5eecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d4795d-55d0-4111-ac3f-3bbe7c904e89', 'volume_name': 'volume-75d4795d-55d0-4111-ac3f-3bbe7c904e89', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:37 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 Sep 04 19:11:37 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe938a0-0078-4c89-9be3-019b592723bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe938a0-0078-4c89-9be3-019b592723bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282889b9-e365-4707-94b4-f42a12e0fdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:37 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Volume 75d4795d-55d0-4111-ac3f-3bbe7c904e89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d4795d-55d0-4111-ac3f-3bbe7c904e89', 'volume_size': 1} Sep 04 19:11:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:38 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-736cd049-9b88-4547-b261-f8b11bb78219 tempest-TestImageHashVerification-343030177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6" returned: 0 in 0.452s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-736cd049-9b88-4547-b261-f8b11bb78219 tempest-TestImageHashVerification-343030177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 /opt/stack/data/cinder/conversion/8a2c18db-0596-4f76-944f-6075cbcdbaa6.temp_image.82c1aabc-4e74-400d-bbb7-db0ff4244347yt2q6yrq.img {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:38 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 /opt/stack/data/cinder/conversion/8a2c18db-0596-4f76-944f-6075cbcdbaa6.temp_image.82c1aabc-4e74-400d-bbb7-db0ff4244347yt2q6yrq.img Sep 04 19:11:38 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:43 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-736cd049-9b88-4547-b261-f8b11bb78219 tempest-TestImageHashVerification-343030177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 /opt/stack/data/cinder/conversion/8a2c18db-0596-4f76-944f-6075cbcdbaa6.temp_image.82c1aabc-4e74-400d-bbb7-db0ff4244347yt2q6yrq.img" returned: 0 in 5.211s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:43 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57de010-6f3c-44a6-a9b4-c03ec5d2ec88]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:11:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-736cd049-9b88-4547-b261-f8b11bb78219 tempest-TestImageHashVerification-343030177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:43 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 Sep 04 19:11:43 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:43 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-736cd049-9b88-4547-b261-f8b11bb78219 tempest-TestImageHashVerification-343030177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6" returned: 0 in 0.559s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:43 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-736cd049-9b88-4547-b261-f8b11bb78219 tempest-TestImageHashVerification-343030177 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6, size 1024.00 MB, duration 5.21 sec, destination /opt/stack/data/cinder/conversion/8a2c18db-0596-4f76-944f-6075cbcdbaa6.temp_image.82c1aabc-4e74-400d-bbb7-db0ff4244347yt2q6yrq.img {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:11:43 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-736cd049-9b88-4547-b261-f8b11bb78219 tempest-TestImageHashVerification-343030177 None] Converted 1024.00 MB image at 196.45 MB/s Sep 04 19:11:43 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-736cd049-9b88-4547-b261-f8b11bb78219 tempest-TestImageHashVerification-343030177 None] 82c1aabc-4e74-400d-bbb7-db0ff4244347 was raw, no need to convert to raw {{(pid=87560) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 04 19:11:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:11:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:11:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:11:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:11:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:11:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:11:45 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:11:45 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:11:45 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Sep 04 19:11:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.375s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:11:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:11:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:11:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:11:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:11:47 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:11:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Flow 'volume_create_manager' (d3fd0295-ce63-425d-9a29-232e50d1a4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:11:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13b7933-4d64-4e57-aad3-988505495a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b13b7933-4d64-4e57-aad3-988505495a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-632375712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a06ba48b-3794-4468-a887-a1d74197407a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa82af92bf964827a25f020187930a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:11:47Z,use_quota=True,user_id='07f9c6f99cdd45cdb9c580238d8356ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bedea1ea-309c-40e9-a008-55412b9e241a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bedea1ea-309c-40e9-a008-55412b9e241a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abc4e57-0c8f-4717-bbcf-d4d8feca62d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6abc4e57-0c8f-4717-bbcf-d4d8feca62d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a06ba48b-3794-4468-a887-a1d74197407a', 'volume_name': 'volume-a06ba48b-3794-4468-a887-a1d74197407a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59dbeced-3c9b-4091-950e-fa007637e6df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59dbeced-3c9b-4091-950e-fa007637e6df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad32aa1c-2e50-4f96-a405-d4163515d07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:47 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Volume a06ba48b-3794-4468-a887-a1d74197407a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a06ba48b-3794-4468-a887-a1d74197407a', 'volume_size': 1} Sep 04 19:11:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:11:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7c2fd9e5-f76d-4d9f-9474-f9643d495fa0 tempest-GroupsTest-1906909718 None] Group tempest-Group1-535677130: creating Sep 04 19:11:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7c2fd9e5-f76d-4d9f-9474-f9643d495fa0 tempest-GroupsTest-1906909718 None] Group tempest-Group1-535677130: created successfully Sep 04 19:11:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7c2fd9e5-f76d-4d9f-9474-f9643d495fa0 tempest-GroupsTest-1906909718 None] Create group completed successfully. Sep 04 19:11:50 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c535b8d9-2f89-4223-a302-8bd8644d5cfd tempest-GroupsTest-1906909718 None] Group tempest-Group2-1445841651: creating Sep 04 19:11:50 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c535b8d9-2f89-4223-a302-8bd8644d5cfd tempest-GroupsTest-1906909718 None] Group tempest-Group2-1445841651: created successfully Sep 04 19:11:50 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c535b8d9-2f89-4223-a302-8bd8644d5cfd tempest-GroupsTest-1906909718 None] Create group completed successfully. Sep 04 19:11:52 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:11:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Flow 'volume_create_manager' (46365427-ae0c-435a-8e94-6a74f1848dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:11:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810d56a0-edd1-4660-948c-0c869c0bc45b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (810d56a0-edd1-4660-948c-0c869c0bc45b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1307738253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=beefb967-a14f-4a9c-b91b-163d6b199bc1,host='devstack@QuobyteHD#QuobyteHD',id=500c6dbe-03b6-4a83-b217-22e3d338f12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadf29bc373241958f19c5e55748839b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:11:53Z,use_quota=True,user_id='694b4f1dc40f4e118b18a086ba2ad272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(012b44cb-55db-49c5-9cc6-538d6d365d18),volume_type_id=012b44cb-55db-49c5-9cc6-538d6d365d18)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ecce2e-040b-4186-bd41-f754f41baebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ecce2e-040b-4186-bd41-f754f41baebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64abcb9c-63bc-423f-abc5-68ed0fbdb660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64abcb9c-63bc-423f-abc5-68ed0fbdb660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '500c6dbe-03b6-4a83-b217-22e3d338f12d', 'volume_name': 'volume-500c6dbe-03b6-4a83-b217-22e3d338f12d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8296fb8d-7482-4d3b-b49c-b7e9ba101fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8296fb8d-7482-4d3b-b49c-b7e9ba101fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:11:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca6ee17-e7d1-4aad-83b7-ca75e0e513b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:11:52 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Volume 500c6dbe-03b6-4a83-b217-22e3d338f12d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-500c6dbe-03b6-4a83-b217-22e3d338f12d', 'volume_size': 1} Sep 04 19:11:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:02 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=56,cinder:SELECT=37,cinder:DELETE=4,cinder:INSERT=11 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:12:02 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=58,cinder:SELECT=50,cinder:INSERT=13,cinder:DELETE=1 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:12:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-736cd049-9b88-4547-b261-f8b11bb78219 tempest-TestImageHashVerification-343030177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.482s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-736cd049-9b88-4547-b261-f8b11bb78219 tempest-TestImageHashVerification-343030177 None] Uploaded volume to glance image-id: 82c1aabc-4e74-400d-bbb7-db0ff4244347. {{(pid=87560) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 19:12:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 25.811s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1657848081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d4795d-55d0-4111-ac3f-3bbe7c904e89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a447b4939549ffa93d5aee6619cb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:11:38Z,use_quota=True,user_id='b75443a0a07a40ee85e79d16ad33ed94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Creating volume 75d4795d-55d0-4111-ac3f-3bbe7c904e89 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:03 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-75d4795d-55d0-4111-ac3f-3bbe7c904e89 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:03 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-75d4795d-55d0-4111-ac3f-3bbe7c904e89 1073741824 Sep 04 19:12:03 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:03 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-736cd049-9b88-4547-b261-f8b11bb78219 tempest-TestImageHashVerification-343030177 None] Copy volume to image completed successfully. Sep 04 19:12:03 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-75d4795d-55d0-4111-ac3f-3bbe7c904e89 1073741824" returned: 0 in 0.400s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-75d4795d-55d0-4111-ac3f-3bbe7c904e89 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:04 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-75d4795d-55d0-4111-ac3f-3bbe7c904e89 Sep 04 19:12:04 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:04 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-75d4795d-55d0-4111-ac3f-3bbe7c904e89" returned: 0 in 0.246s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.765s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-632375712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a06ba48b-3794-4468-a887-a1d74197407a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa82af92bf964827a25f020187930a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:11:47Z,use_quota=True,user_id='07f9c6f99cdd45cdb9c580238d8356ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Creating volume a06ba48b-3794-4468-a887-a1d74197407a {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:04 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a06ba48b-3794-4468-a887-a1d74197407a 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (282889b9-e365-4707-94b4-f42a12e0fdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d4795d-55d0-4111-ac3f-3bbe7c904e89', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:04 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a06ba48b-3794-4468-a887-a1d74197407a 1073741824 Sep 04 19:12:04 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f36d754-e2ab-4118-96e6-e4e4c94e158a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:04 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Volume volume-75d4795d-55d0-4111-ac3f-3bbe7c904e89 (75d4795d-55d0-4111-ac3f-3bbe7c904e89): created successfully Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f36d754-e2ab-4118-96e6-e4e4c94e158a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Flow 'volume_create_manager' (f0ec1199-0fcf-404b-a356-c0caa6e147d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:04 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f3bfcc0c-7b98-48cb-bb16-8a51a1fb4ea4 tempest-VolumesListAdminTestJSON-1408439017 None] Created volume successfully. Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Acquiring lock "cinder-8a2c18db-0596-4f76-944f-6075cbcdbaa6-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Lock "cinder-8a2c18db-0596-4f76-944f-6075cbcdbaa6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:04 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a06ba48b-3794-4468-a887-a1d74197407a 1073741824" returned: 0 in 0.468s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Acquiring lock "cinder-quobyte-8a2c18db-0596-4f76-944f-6075cbcdbaa6" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Lock "cinder-quobyte-8a2c18db-0596-4f76-944f-6075cbcdbaa6" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a06ba48b-3794-4468-a887-a1d74197407a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a8a333-d042-4dbe-8ac9-e58207935a83]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:04 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a06ba48b-3794-4468-a887-a1d74197407a Sep 04 19:12:04 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:04 devstack sudo[97025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 Sep 04 19:12:04 devstack sudo[97025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:05 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a06ba48b-3794-4468-a887-a1d74197407a" returned: 0 in 0.261s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.294s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=beefb967-a14f-4a9c-b91b-163d6b199bc1,created_at=2026-09-04T17:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1307738253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=beefb967-a14f-4a9c-b91b-163d6b199bc1,host='devstack@QuobyteHD#QuobyteHD',id=500c6dbe-03b6-4a83-b217-22e3d338f12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadf29bc373241958f19c5e55748839b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:11:53Z,use_quota=True,user_id='694b4f1dc40f4e118b18a086ba2ad272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(012b44cb-55db-49c5-9cc6-538d6d365d18),volume_type_id=012b44cb-55db-49c5-9cc6-538d6d365d18)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Creating volume 500c6dbe-03b6-4a83-b217-22e3d338f12d {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:05 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-500c6dbe-03b6-4a83-b217-22e3d338f12d 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:05 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-500c6dbe-03b6-4a83-b217-22e3d338f12d 1073741824 Sep 04 19:12:05 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad32aa1c-2e50-4f96-a405-d4163515d07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a06ba48b-3794-4468-a887-a1d74197407a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e6718e7-b234-4bde-88b4-b8d57ca27cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:05 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Volume volume-a06ba48b-3794-4468-a887-a1d74197407a (a06ba48b-3794-4468-a887-a1d74197407a): created successfully Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e6718e7-b234-4bde-88b4-b8d57ca27cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Flow 'volume_create_manager' (d3fd0295-ce63-425d-9a29-232e50d1a4f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:05 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e3b9a25f-84b2-4fe5-adff-c43e0c6c3a8c tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Created volume successfully. Sep 04 19:12:05 devstack sudo[97025]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6" returned: 0 in 0.416s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:05 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6 Sep 04 19:12:05 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Flow 'volume_create_manager' (b2c27f1a-659b-48cb-b6b2-9ba911a41ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a3bbf2-43fa-4be0-976a-0d8e5341d3bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a3bbf2-43fa-4be0-976a-0d8e5341d3bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1577146491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615e7b47-f4c0-4b53-8fd2-da97127d8547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a447b4939549ffa93d5aee6619cb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:05Z,use_quota=True,user_id='b75443a0a07a40ee85e79d16ad33ed94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cbb52b-6eaf-45bb-95f7-973efc755991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1cbb52b-6eaf-45bb-95f7-973efc755991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262e1b19-fe80-4794-8c81-6ff6d979483b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (262e1b19-fe80-4794-8c81-6ff6d979483b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '615e7b47-f4c0-4b53-8fd2-da97127d8547', 'volume_name': 'volume-615e7b47-f4c0-4b53-8fd2-da97127d8547', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba25c50f-9cf3-4ae6-b530-bf84c717f1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba25c50f-9cf3-4ae6-b530-bf84c717f1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c26d3d-e401-45c3-a9e9-7a8bf1784764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:05 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Volume 615e7b47-f4c0-4b53-8fd2-da97127d8547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-615e7b47-f4c0-4b53-8fd2-da97127d8547', 'volume_size': 1} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:05 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8a2c18db-0596-4f76-944f-6075cbcdbaa6" returned: 0 in 0.372s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Lock "cinder-quobyte-8a2c18db-0596-4f76-944f-6075cbcdbaa6" released by "delete_volume" :: held 0.830s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:05 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-500c6dbe-03b6-4a83-b217-22e3d338f12d 1073741824" returned: 0 in 0.578s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Created reservations ['1c231ba6-15b0-41bf-a7c7-ed3d9d99db6e', '9bec5341-b57b-47e7-b5ff-d6b4508ddf0f', '72735905-686c-417d-9834-b268bdfe92cc', '2d393f49-06ef-44c5-8971-ee3c8879ee58'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-500c6dbe-03b6-4a83-b217-22e3d338f12d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:05 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-500c6dbe-03b6-4a83-b217-22e3d338f12d Sep 04 19:12:05 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:05 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:05 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:06 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-500c6dbe-03b6-4a83-b217-22e3d338f12d" returned: 0 in 0.357s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.503s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1577146491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615e7b47-f4c0-4b53-8fd2-da97127d8547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a447b4939549ffa93d5aee6619cb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:05Z,use_quota=True,user_id='b75443a0a07a40ee85e79d16ad33ed94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Creating volume 615e7b47-f4c0-4b53-8fd2-da97127d8547 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:06 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-615e7b47-f4c0-4b53-8fd2-da97127d8547 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:06 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.336s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:06 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-615e7b47-f4c0-4b53-8fd2-da97127d8547 1073741824 Sep 04 19:12:06 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca6ee17-e7d1-4aad-83b7-ca75e0e513b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-500c6dbe-03b6-4a83-b217-22e3d338f12d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3253e5-abd2-4989-a7d0-437174717b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Deleted volume successfully. Sep 04 19:12:06 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Volume volume-500c6dbe-03b6-4a83-b217-22e3d338f12d (500c6dbe-03b6-4a83-b217-22e3d338f12d): created successfully Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d3253e5-abd2-4989-a7d0-437174717b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Flow 'volume_create_manager' (46365427-ae0c-435a-8e94-6a74f1848dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e8054541-154e-47ec-a474-1e35755f5c97 tempest-TestImageHashVerification-343030177 None] Lock "cinder-8a2c18db-0596-4f76-944f-6075cbcdbaa6-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4081d7bd-50e7-4e7d-ae7a-d0224b0c726e tempest-GroupsTest-1906909718 None] Created volume successfully. Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Acquiring lock "cinder-a06ba48b-3794-4468-a887-a1d74197407a-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Lock "cinder-a06ba48b-3794-4468-a887-a1d74197407a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Acquiring lock "cinder-quobyte-a06ba48b-3794-4468-a887-a1d74197407a" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Lock "cinder-quobyte-a06ba48b-3794-4468-a887-a1d74197407a" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fdc30e-b94c-469e-99c8-8ea0492bbcc2]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a06ba48b-3794-4468-a887-a1d74197407a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:06 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-615e7b47-f4c0-4b53-8fd2-da97127d8547 1073741824" returned: 0 in 0.670s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-615e7b47-f4c0-4b53-8fd2-da97127d8547 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:06 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-615e7b47-f4c0-4b53-8fd2-da97127d8547 Sep 04 19:12:06 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:06 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a06ba48b-3794-4468-a887-a1d74197407a Sep 04 19:12:06 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:07 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-615e7b47-f4c0-4b53-8fd2-da97127d8547" returned: 0 in 0.329s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c26d3d-e401-45c3-a9e9-7a8bf1784764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-615e7b47-f4c0-4b53-8fd2-da97127d8547', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383b0ff9-ae39-46a8-8fdf-9c6d949a8dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:07 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:07 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Volume volume-615e7b47-f4c0-4b53-8fd2-da97127d8547 (615e7b47-f4c0-4b53-8fd2-da97127d8547): created successfully Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383b0ff9-ae39-46a8-8fdf-9c6d949a8dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Flow 'volume_create_manager' (b2c27f1a-659b-48cb-b6b2-9ba911a41ffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a06ba48b-3794-4468-a887-a1d74197407a" returned: 0 in 0.500s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a06ba48b-3794-4468-a887-a1d74197407a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-174c0d79-d0f7-4496-a460-a8a47e559f86 tempest-VolumesListAdminTestJSON-1408439017 None] Created volume successfully. Sep 04 19:12:07 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a06ba48b-3794-4468-a887-a1d74197407a Sep 04 19:12:07 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:07 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a06ba48b-3794-4468-a887-a1d74197407a" returned: 0 in 0.272s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Lock "cinder-quobyte-a06ba48b-3794-4468-a887-a1d74197407a" released by "delete_volume" :: held 0.858s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Acquiring lock "cinder-quobyte-500c6dbe-03b6-4a83-b217-22e3d338f12d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Lock "cinder-quobyte-500c6dbe-03b6-4a83-b217-22e3d338f12d" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d07b37a-640c-4878-83c5-2709fea4ff8d]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-500c6dbe-03b6-4a83-b217-22e3d338f12d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Created reservations ['4aec10fa-973f-4b0c-9bf7-813984b680f9', 'd75c9a72-152e-4d94-a98f-0c00999cf001', '88f4a633-8d4d-4fb2-96a4-677da7ea4734', '170bffef-6c4d-4d20-9a99-782834944624'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:07 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-500c6dbe-03b6-4a83-b217-22e3d338f12d Sep 04 19:12:07 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:07 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:07 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:08 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.290s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:08 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Deleted volume successfully. Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-500c6dbe-03b6-4a83-b217-22e3d338f12d" returned: 0 in 0.556s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-500c6dbe-03b6-4a83-b217-22e3d338f12d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:08 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-500c6dbe-03b6-4a83-b217-22e3d338f12d Sep 04 19:12:08 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-afc09c92-82da-4ad6-866c-1d360386f9ce tempest-VolumeQuotasNegativeTestJSON-1912139897 None] Lock "cinder-a06ba48b-3794-4468-a887-a1d74197407a-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Flow 'volume_create_manager' (90d585de-2ada-4f0d-b416-eb413dcba6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a87652-f6d9-409f-b705-8f6039efa806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21a87652-f6d9-409f-b705-8f6039efa806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-893604575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac62a5c6-3a80-4773-afd7-2cef9f8726be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a447b4939549ffa93d5aee6619cb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:08Z,use_quota=True,user_id='b75443a0a07a40ee85e79d16ad33ed94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025818bc-6079-43c7-a462-5948b091011d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025818bc-6079-43c7-a462-5948b091011d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77f0a85-88cd-4b71-aeda-37e65e068ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77f0a85-88cd-4b71-aeda-37e65e068ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac62a5c6-3a80-4773-afd7-2cef9f8726be', 'volume_name': 'volume-ac62a5c6-3a80-4773-afd7-2cef9f8726be', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e680b62-167c-4b38-aadf-0e6e3571ad7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e680b62-167c-4b38-aadf-0e6e3571ad7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1dc9c6-8ae9-4226-b165-0db062ab9239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:08 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Volume ac62a5c6-3a80-4773-afd7-2cef9f8726be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac62a5c6-3a80-4773-afd7-2cef9f8726be', 'volume_size': 1} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-893604575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac62a5c6-3a80-4773-afd7-2cef9f8726be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18a447b4939549ffa93d5aee6619cb7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:08Z,use_quota=True,user_id='b75443a0a07a40ee85e79d16ad33ed94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Creating volume ac62a5c6-3a80-4773-afd7-2cef9f8726be {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:08 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac62a5c6-3a80-4773-afd7-2cef9f8726be 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:08 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac62a5c6-3a80-4773-afd7-2cef9f8726be 1073741824 Sep 04 19:12:08 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:08 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-500c6dbe-03b6-4a83-b217-22e3d338f12d" returned: 0 in 0.287s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Lock "cinder-quobyte-500c6dbe-03b6-4a83-b217-22e3d338f12d" released by "delete_volume" :: held 0.899s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Created reservations ['6c030a4a-d122-4650-99f8-4f1533872a67'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:08 devstack cinder-volume[87560]: WARNING cinder.quota [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1554753587 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1554753587, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:12:08 devstack cinder-volume[87560]: WARNING cinder.quota [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1554753587 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1554753587, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Created reservations ['3e1afa17-8ea4-4737-8336-9ee3cf7d1ef1', 'ce194fb4-6ae5-4c3c-952d-210f2e40aff8', '812247da-5ea9-47e1-bae1-41fabedb6de4', '0eb5365e-1956-48f4-92ea-691bc5bb67c1'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:08 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:08 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:08 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac62a5c6-3a80-4773-afd7-2cef9f8726be 1073741824" returned: 0 in 0.551s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac62a5c6-3a80-4773-afd7-2cef9f8726be {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:08 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac62a5c6-3a80-4773-afd7-2cef9f8726be Sep 04 19:12:08 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:09 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.402s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d9b92a15-f34b-4aff-8ed5-c0ac93f95270 tempest-GroupsTest-1906909718 None] Delete group completed successfully. Sep 04 19:12:09 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac62a5c6-3a80-4773-afd7-2cef9f8726be" returned: 0 in 0.354s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1dc9c6-8ae9-4226-b165-0db062ab9239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac62a5c6-3a80-4773-afd7-2cef9f8726be', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01aa02ac-1903-4b33-8580-4465b6856bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:09 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Volume volume-ac62a5c6-3a80-4773-afd7-2cef9f8726be (ac62a5c6-3a80-4773-afd7-2cef9f8726be): created successfully Sep 04 19:12:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01aa02ac-1903-4b33-8580-4465b6856bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Flow 'volume_create_manager' (90d585de-2ada-4f0d-b416-eb413dcba6e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1c53d8cc-8ab7-426a-bada-bd923734101b tempest-VolumesListAdminTestJSON-1408439017 None] Created volume successfully. Sep 04 19:12:09 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-e213762a-71ef-4b35-9dc7-e5143920b741 tempest-GroupsTest-1906909718 None] Created reservations ['d016029f-5796-4280-a89c-110c953cd5ec'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e213762a-71ef-4b35-9dc7-e5143920b741 tempest-GroupsTest-1906909718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e213762a-71ef-4b35-9dc7-e5143920b741 tempest-GroupsTest-1906909718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e213762a-71ef-4b35-9dc7-e5143920b741 tempest-GroupsTest-1906909718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e213762a-71ef-4b35-9dc7-e5143920b741 tempest-GroupsTest-1906909718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e213762a-71ef-4b35-9dc7-e5143920b741 tempest-GroupsTest-1906909718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e213762a-71ef-4b35-9dc7-e5143920b741 tempest-GroupsTest-1906909718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:10 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:10 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:10 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e213762a-71ef-4b35-9dc7-e5143920b741 tempest-GroupsTest-1906909718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.337s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:10 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-e213762a-71ef-4b35-9dc7-e5143920b741 tempest-GroupsTest-1906909718 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e213762a-71ef-4b35-9dc7-e5143920b741 tempest-GroupsTest-1906909718 None] Delete group completed successfully. Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Flow 'volume_create_manager' (6b9ff7bd-1b15-44e7-9de4-d9219c88e390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e9578c-e90f-4f22-879c-d0ad2b1cd66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15e9578c-e90f-4f22-879c-d0ad2b1cd66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4d374e-e7c3-4e25-9edc-bd2048ebffec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a300fe2051f4782a2a53df25a9c03f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:11Z,use_quota=True,user_id='17de2349c78b41349d2b90dcb141df5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46a3107-c77d-4ff6-8e9a-582ba7a68d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46a3107-c77d-4ff6-8e9a-582ba7a68d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7582aa7b-ae7e-42d5-8a11-b9af03804cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7582aa7b-ae7e-42d5-8a11-b9af03804cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e4d374e-e7c3-4e25-9edc-bd2048ebffec', 'volume_name': 'volume-0e4d374e-e7c3-4e25-9edc-bd2048ebffec', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5364e6b-440b-41f3-8705-1f3c18186724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5364e6b-440b-41f3-8705-1f3c18186724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51890c4-2280-4dd2-8c66-0011f4b0c4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:11 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Volume 0e4d374e-e7c3-4e25-9edc-bd2048ebffec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e4d374e-e7c3-4e25-9edc-bd2048ebffec', 'volume_size': 1} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4d374e-e7c3-4e25-9edc-bd2048ebffec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a300fe2051f4782a2a53df25a9c03f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:11Z,use_quota=True,user_id='17de2349c78b41349d2b90dcb141df5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Creating volume 0e4d374e-e7c3-4e25-9edc-bd2048ebffec {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:11 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0e4d374e-e7c3-4e25-9edc-bd2048ebffec 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:11 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0e4d374e-e7c3-4e25-9edc-bd2048ebffec 1073741824 Sep 04 19:12:11 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-43aa6823-6d91-435b-aff4-9ac64bd9c87d tempest-GroupsTest-1906909718 None] Group tempest-GroupsTest-Group-134415927: creating Sep 04 19:12:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-43aa6823-6d91-435b-aff4-9ac64bd9c87d tempest-GroupsTest-1906909718 None] Group tempest-GroupsTest-Group-134415927: created successfully Sep 04 19:12:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-43aa6823-6d91-435b-aff4-9ac64bd9c87d tempest-GroupsTest-1906909718 None] Create group completed successfully. Sep 04 19:12:12 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0e4d374e-e7c3-4e25-9edc-bd2048ebffec 1073741824" returned: 0 in 0.575s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0e4d374e-e7c3-4e25-9edc-bd2048ebffec {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:12 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0e4d374e-e7c3-4e25-9edc-bd2048ebffec Sep 04 19:12:12 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:12 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0e4d374e-e7c3-4e25-9edc-bd2048ebffec" returned: 0 in 0.292s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e51890c4-2280-4dd2-8c66-0011f4b0c4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e4d374e-e7c3-4e25-9edc-bd2048ebffec', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87937446-493c-492b-b623-0eeddbf0eec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:12 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Volume volume-0e4d374e-e7c3-4e25-9edc-bd2048ebffec (0e4d374e-e7c3-4e25-9edc-bd2048ebffec): created successfully Sep 04 19:12:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87937446-493c-492b-b623-0eeddbf0eec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Flow 'volume_create_manager' (6b9ff7bd-1b15-44e7-9de4-d9219c88e390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:12 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-28feb16a-428a-4e84-ad05-05635b8fb0a9 tempest-VolumesListAdminTestJSON-2021877224 None] Created volume successfully. Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Flow 'volume_create_manager' (f14c004b-68b9-4fe4-8473-34a531bcb13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008db2f0-8ea5-4a9e-905c-86731889f81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (008db2f0-8ea5-4a9e-905c-86731889f81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-775315229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59a32069-b082-4282-957b-10db4b14a3b5,host='devstack@QuobyteHD#QuobyteHD',id=e0a01489-0870-4f1b-ba72-60914da62377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadf29bc373241958f19c5e55748839b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:13Z,use_quota=True,user_id='694b4f1dc40f4e118b18a086ba2ad272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2dc351-b10d-4ebe-b139-ebdabb6425e0),volume_type_id=cc2dc351-b10d-4ebe-b139-ebdabb6425e0)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d72d217-4f89-411d-9d53-b5445dbace12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d72d217-4f89-411d-9d53-b5445dbace12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92eb7406-f0dd-4fcf-9dfc-5ebc05a6fb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92eb7406-f0dd-4fcf-9dfc-5ebc05a6fb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0a01489-0870-4f1b-ba72-60914da62377', 'volume_name': 'volume-e0a01489-0870-4f1b-ba72-60914da62377', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde0c6fc-a0d5-4269-97af-be9b6294da9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde0c6fc-a0d5-4269-97af-be9b6294da9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3c6da7-b981-4efe-897f-7f3972156cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:13 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Volume e0a01489-0870-4f1b-ba72-60914da62377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0a01489-0870-4f1b-ba72-60914da62377', 'volume_size': 1} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=59a32069-b082-4282-957b-10db4b14a3b5,created_at=2026-09-04T17:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-775315229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59a32069-b082-4282-957b-10db4b14a3b5,host='devstack@QuobyteHD#QuobyteHD',id=e0a01489-0870-4f1b-ba72-60914da62377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadf29bc373241958f19c5e55748839b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:13Z,use_quota=True,user_id='694b4f1dc40f4e118b18a086ba2ad272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2dc351-b10d-4ebe-b139-ebdabb6425e0),volume_type_id=cc2dc351-b10d-4ebe-b139-ebdabb6425e0)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Creating volume e0a01489-0870-4f1b-ba72-60914da62377 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:13 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e0a01489-0870-4f1b-ba72-60914da62377 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:13 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e0a01489-0870-4f1b-ba72-60914da62377 1073741824 Sep 04 19:12:13 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Acquiring lock "cinder-0e4d374e-e7c3-4e25-9edc-bd2048ebffec-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Lock "cinder-0e4d374e-e7c3-4e25-9edc-bd2048ebffec-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Acquiring lock "cinder-quobyte-0e4d374e-e7c3-4e25-9edc-bd2048ebffec" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Lock "cinder-quobyte-0e4d374e-e7c3-4e25-9edc-bd2048ebffec" acquired by "delete_volume" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Acquiring lock "cinder-ac62a5c6-3a80-4773-afd7-2cef9f8726be-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4252d082-fa84-4a71-a73a-34c5366fdfc5]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0e4d374e-e7c3-4e25-9edc-bd2048ebffec {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "cinder-ac62a5c6-3a80-4773-afd7-2cef9f8726be-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Acquiring lock "cinder-quobyte-ac62a5c6-3a80-4773-afd7-2cef9f8726be" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "cinder-quobyte-ac62a5c6-3a80-4773-afd7-2cef9f8726be" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[020a0b01-8e3e-4bcc-86ab-c1aa86cdea7d]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac62a5c6-3a80-4773-afd7-2cef9f8726be {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:14 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0e4d374e-e7c3-4e25-9edc-bd2048ebffec Sep 04 19:12:14 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:14 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac62a5c6-3a80-4773-afd7-2cef9f8726be Sep 04 19:12:14 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:14 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e0a01489-0870-4f1b-ba72-60914da62377 1073741824" returned: 0 in 0.723s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e0a01489-0870-4f1b-ba72-60914da62377 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:14 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0e4d374e-e7c3-4e25-9edc-bd2048ebffec" returned: 0 in 0.519s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0e4d374e-e7c3-4e25-9edc-bd2048ebffec {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:14 devstack sudo[97121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e0a01489-0870-4f1b-ba72-60914da62377 Sep 04 19:12:14 devstack sudo[97121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:14 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0e4d374e-e7c3-4e25-9edc-bd2048ebffec Sep 04 19:12:14 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:14 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac62a5c6-3a80-4773-afd7-2cef9f8726be" returned: 0 in 0.561s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac62a5c6-3a80-4773-afd7-2cef9f8726be {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:14 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac62a5c6-3a80-4773-afd7-2cef9f8726be Sep 04 19:12:14 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:14 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:14 devstack sudo[97121]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0e4d374e-e7c3-4e25-9edc-bd2048ebffec" returned: 0 in 0.389s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e0a01489-0870-4f1b-ba72-60914da62377" returned: 0 in 0.423s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] <== create_volume: return (1214ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Lock "cinder-quobyte-0e4d374e-e7c3-4e25-9edc-bd2048ebffec" released by "delete_volume" :: held 0.983s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3c6da7-b981-4efe-897f-7f3972156cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0a01489-0870-4f1b-ba72-60914da62377', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db1d6c7-4415-4de8-8e0c-f538bf2cf3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:14 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Volume volume-e0a01489-0870-4f1b-ba72-60914da62377 (e0a01489-0870-4f1b-ba72-60914da62377): created successfully Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3db1d6c7-4415-4de8-8e0c-f538bf2cf3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Flow 'volume_create_manager' (f14c004b-68b9-4fe4-8473-34a531bcb13f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-78eebf2c-c3fb-4d22-b89e-73a2678a235f tempest-GroupsTest-1906909718 None] Created volume successfully. Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Created reservations ['72ab4d08-993a-49ea-83b3-2b92919b5496', '61edebfd-6245-43c4-a5ed-6fd586fd0240', '18ebc710-2816-499d-aa85-5fa307fc09f2', '3ab8aa79-b7af-4d85-a075-9e00a3206ee0'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:15 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac62a5c6-3a80-4773-afd7-2cef9f8726be" returned: 0 in 0.492s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "cinder-quobyte-ac62a5c6-3a80-4773-afd7-2cef9f8726be" released by "delete_volume" :: held 1.108s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:15 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:15 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Created reservations ['a65c1fdc-e23d-4668-a5e9-248a9427ed0a', '0ef07ed9-e243-4466-b5ea-5f661f6bb259', 'd7e507bd-97cc-41f2-a399-163d951c589e', 'da944145-f9c7-4340-ac36-68bb7414aca1'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:15 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:15 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:15 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.288s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Deleted volume successfully. Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7ee8de33-1ef8-4c55-b726-e250faee976d tempest-VolumesListAdminTestJSON-2021877224 None] Lock "cinder-0e4d374e-e7c3-4e25-9edc-bd2048ebffec-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:15 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.279s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Deleted volume successfully. Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f66c6d03-1f0c-4b45-9117-f64be34ee826 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "cinder-ac62a5c6-3a80-4773-afd7-2cef9f8726be-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Flow 'volume_create_manager' (160bacfd-774b-4e09-ac88-d49fd94ff891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f51be9-849f-4a8c-9b5b-679d3112e0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5f51be9-849f-4a8c-9b5b-679d3112e0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1401348621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e3e446-2df7-4c8d-9076-115c7a8acc83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e229c6c000bd498fad88e83d0d27e08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:16Z,use_quota=True,user_id='219d4c78e8034dd8abe79f40aeecf9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf693c99-f8ee-4944-a05b-98be36ac3d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf693c99-f8ee-4944-a05b-98be36ac3d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8187fd-c25a-4d72-a795-1ede338791df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a8187fd-c25a-4d72-a795-1ede338791df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96e3e446-2df7-4c8d-9076-115c7a8acc83', 'volume_name': 'volume-96e3e446-2df7-4c8d-9076-115c7a8acc83', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c347a5f3-f217-4341-9fd8-bf4a9b071782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c347a5f3-f217-4341-9fd8-bf4a9b071782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03263015-fa19-467e-a066-036b13326af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Volume 96e3e446-2df7-4c8d-9076-115c7a8acc83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96e3e446-2df7-4c8d-9076-115c7a8acc83', 'volume_size': 1} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1401348621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96e3e446-2df7-4c8d-9076-115c7a8acc83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e229c6c000bd498fad88e83d0d27e08d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:16Z,use_quota=True,user_id='219d4c78e8034dd8abe79f40aeecf9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Creating volume 96e3e446-2df7-4c8d-9076-115c7a8acc83 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:15 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-96e3e446-2df7-4c8d-9076-115c7a8acc83 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:15 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-96e3e446-2df7-4c8d-9076-115c7a8acc83 1073741824 Sep 04 19:12:15 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Acquiring lock "cinder-615e7b47-f4c0-4b53-8fd2-da97127d8547-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "cinder-615e7b47-f4c0-4b53-8fd2-da97127d8547-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:16 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-96e3e446-2df7-4c8d-9076-115c7a8acc83 1073741824" returned: 0 in 0.598s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Acquiring lock "cinder-quobyte-615e7b47-f4c0-4b53-8fd2-da97127d8547" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "cinder-quobyte-615e7b47-f4c0-4b53-8fd2-da97127d8547" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-96e3e446-2df7-4c8d-9076-115c7a8acc83 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6afbe6-9e25-4ea6-970e-3500907adb28]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-615e7b47-f4c0-4b53-8fd2-da97127d8547 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:16 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-96e3e446-2df7-4c8d-9076-115c7a8acc83 Sep 04 19:12:16 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:16 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-615e7b47-f4c0-4b53-8fd2-da97127d8547 Sep 04 19:12:16 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:16 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-96e3e446-2df7-4c8d-9076-115c7a8acc83" returned: 0 in 0.317s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Flow 'volume_create_manager' (8ba6c4c6-c3f3-4718-acd1-e7c228306a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (834d5024-c147-4e2b-8b34-1d4cfb94f0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03263015-fa19-467e-a066-036b13326af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96e3e446-2df7-4c8d-9076-115c7a8acc83', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caeee578-d663-41d4-b402-8d2167ac6df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (834d5024-c147-4e2b-8b34-1d4cfb94f0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-681829873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59a32069-b082-4282-957b-10db4b14a3b5,host='devstack@QuobyteHD#QuobyteHD',id=956bf248-e79d-4b3c-96b6-a8d7925f4583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadf29bc373241958f19c5e55748839b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:17Z,use_quota=True,user_id='694b4f1dc40f4e118b18a086ba2ad272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2dc351-b10d-4ebe-b139-ebdabb6425e0),volume_type_id=cc2dc351-b10d-4ebe-b139-ebdabb6425e0)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ae23b2-ed32-4794-b7ec-67d473e5bfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8ae23b2-ed32-4794-b7ec-67d473e5bfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe5aefa-0ca5-4f16-b4af-730e114aa217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fe5aefa-0ca5-4f16-b4af-730e114aa217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '956bf248-e79d-4b3c-96b6-a8d7925f4583', 'volume_name': 'volume-956bf248-e79d-4b3c-96b6-a8d7925f4583', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59d2730-07db-43af-8d39-c3d0dcd834ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c59d2730-07db-43af-8d39-c3d0dcd834ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53b5eb2-3b37-4aa2-b528-8fa564baae32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:16 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Volume 956bf248-e79d-4b3c-96b6-a8d7925f4583: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-956bf248-e79d-4b3c-96b6-a8d7925f4583', 'volume_size': 1} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=59a32069-b082-4282-957b-10db4b14a3b5,created_at=2026-09-04T17:12:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-681829873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59a32069-b082-4282-957b-10db4b14a3b5,host='devstack@QuobyteHD#QuobyteHD',id=956bf248-e79d-4b3c-96b6-a8d7925f4583,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadf29bc373241958f19c5e55748839b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:17Z,use_quota=True,user_id='694b4f1dc40f4e118b18a086ba2ad272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc2dc351-b10d-4ebe-b139-ebdabb6425e0),volume_type_id=cc2dc351-b10d-4ebe-b139-ebdabb6425e0)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Creating volume 956bf248-e79d-4b3c-96b6-a8d7925f4583 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:16 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-956bf248-e79d-4b3c-96b6-a8d7925f4583 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:16 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Volume volume-96e3e446-2df7-4c8d-9076-115c7a8acc83 (96e3e446-2df7-4c8d-9076-115c7a8acc83): created successfully Sep 04 19:12:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caeee578-d663-41d4-b402-8d2167ac6df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Flow 'volume_create_manager' (160bacfd-774b-4e09-ac88-d49fd94ff891) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:17 devstack sudo[97151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-956bf248-e79d-4b3c-96b6-a8d7925f4583 1073741824 Sep 04 19:12:17 devstack sudo[97151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6da04605-fb2d-4933-aaf7-17a2563d231b tempest-VolumesServicesTestJSON-950443282 None] Created volume successfully. Sep 04 19:12:17 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-615e7b47-f4c0-4b53-8fd2-da97127d8547" returned: 0 in 0.542s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-615e7b47-f4c0-4b53-8fd2-da97127d8547 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:17 devstack sudo[97156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-615e7b47-f4c0-4b53-8fd2-da97127d8547 Sep 04 19:12:17 devstack sudo[97156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:17 devstack sudo[97156]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-615e7b47-f4c0-4b53-8fd2-da97127d8547" returned: 0 in 0.311s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "cinder-quobyte-615e7b47-f4c0-4b53-8fd2-da97127d8547" released by "delete_volume" :: held 0.933s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:17 devstack sudo[97151]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-956bf248-e79d-4b3c-96b6-a8d7925f4583 1073741824" returned: 0 in 0.520s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Created reservations ['c0d1f367-ef03-461e-98be-3ac45a8760b1', '9dd215de-4cd4-4e77-a0b2-f8dcdcee2b3b', '419c34f4-fddd-4199-9a0b-7f6e15a08399', '5cf4842a-a6de-409c-bd97-fb3f5710522e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-956bf248-e79d-4b3c-96b6-a8d7925f4583 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:17 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-956bf248-e79d-4b3c-96b6-a8d7925f4583 Sep 04 19:12:17 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:17 devstack sudo[97166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:17 devstack sudo[97166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:17 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-956bf248-e79d-4b3c-96b6-a8d7925f4583" returned: 0 in 0.255s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a53b5eb2-3b37-4aa2-b528-8fa564baae32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-956bf248-e79d-4b3c-96b6-a8d7925f4583', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a985034-b7cc-4e15-9010-b546fa9db64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:17 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Volume volume-956bf248-e79d-4b3c-96b6-a8d7925f4583 (956bf248-e79d-4b3c-96b6-a8d7925f4583): created successfully Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a985034-b7cc-4e15-9010-b546fa9db64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Flow 'volume_create_manager' (8ba6c4c6-c3f3-4718-acd1-e7c228306a5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:17 devstack sudo[97166]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-eb96872f-c7a9-42cb-8779-4c52c2b31de1 tempest-GroupsTest-1906909718 None] Created volume successfully. Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.281s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Deleted volume successfully. Sep 04 19:12:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7c5bec17-69e0-4c05-88f5-f90bac30e2b2 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "cinder-615e7b47-f4c0-4b53-8fd2-da97127d8547-delete_volume" released by "delete_volume" :: held 1.511s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Acquiring lock "cinder-96e3e446-2df7-4c8d-9076-115c7a8acc83-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Lock "cinder-96e3e446-2df7-4c8d-9076-115c7a8acc83-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Acquiring lock "cinder-quobyte-96e3e446-2df7-4c8d-9076-115c7a8acc83" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Lock "cinder-quobyte-96e3e446-2df7-4c8d-9076-115c7a8acc83" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c6fd1cd9-03e2-45ee-b500-836b0c27981b tempest-GroupsTest-1906909718 None] Update group completed successfully. Sep 04 19:12:18 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fec1ebbb-d008-476e-9d77-07e5858e0b9b]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-96e3e446-2df7-4c8d-9076-115c7a8acc83 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:18 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-96e3e446-2df7-4c8d-9076-115c7a8acc83 Sep 04 19:12:18 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:18 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-96e3e446-2df7-4c8d-9076-115c7a8acc83" returned: 0 in 0.402s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-96e3e446-2df7-4c8d-9076-115c7a8acc83 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Acquiring lock "cinder-75d4795d-55d0-4111-ac3f-3bbe7c904e89-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:18 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-96e3e446-2df7-4c8d-9076-115c7a8acc83 Sep 04 19:12:18 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "cinder-75d4795d-55d0-4111-ac3f-3bbe7c904e89-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Acquiring lock "cinder-quobyte-75d4795d-55d0-4111-ac3f-3bbe7c904e89" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "cinder-quobyte-75d4795d-55d0-4111-ac3f-3bbe7c904e89" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:18 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[525e08c3-53d7-4126-b35b-119365d230af]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-75d4795d-55d0-4111-ac3f-3bbe7c904e89 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:18 devstack sudo[97177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-75d4795d-55d0-4111-ac3f-3bbe7c904e89 Sep 04 19:12:18 devstack sudo[97177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:18 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-96e3e446-2df7-4c8d-9076-115c7a8acc83" returned: 0 in 0.289s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Lock "cinder-quobyte-96e3e446-2df7-4c8d-9076-115c7a8acc83" released by "delete_volume" :: held 0.752s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Created reservations ['f953b450-f077-4be1-b763-0dbb38ec4afd', '70e0ef57-4506-4d7e-a0e4-9570635737e3', '22ef2531-9b2d-429a-9f30-5032cdaf2279', 'b200e678-3cdf-4279-9f65-fb4188489563'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:19 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:19 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:19 devstack sudo[97177]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-75d4795d-55d0-4111-ac3f-3bbe7c904e89" returned: 0 in 0.504s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-75d4795d-55d0-4111-ac3f-3bbe7c904e89 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:19 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-75d4795d-55d0-4111-ac3f-3bbe7c904e89 Sep 04 19:12:19 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:19 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.444s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Deleted volume successfully. Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d0d135e2-db86-4497-80ff-1a9f17815c25 tempest-VolumesServicesTestJSON-950443282 None] Lock "cinder-96e3e446-2df7-4c8d-9076-115c7a8acc83-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f1d9779e-aedf-452b-9f8a-ad928befd556 tempest-GroupsTest-1906909718 None] Update group completed successfully. Sep 04 19:12:19 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-75d4795d-55d0-4111-ac3f-3bbe7c904e89" returned: 0 in 0.377s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "cinder-quobyte-75d4795d-55d0-4111-ac3f-3bbe7c904e89" released by "delete_volume" :: held 0.920s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Created reservations ['8935d6e6-d1c1-4a1a-8027-3652be309a6a', '25ec7c65-4338-46ca-81c0-4a27bd487fa4', 'c0940e79-3724-4efc-b32d-f47d9f977933', '3c503237-fdf5-4519-a317-57ccf3ed6f39'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:19 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:19 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:20 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.255s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:20 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:20 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Deleted volume successfully. Sep 04 19:12:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa54a63e-3e9c-42e2-b396-d8c0b1480395 tempest-VolumesListAdminTestJSON-1408439017 None] Lock "cinder-75d4795d-55d0-4111-ac3f-3bbe7c904e89-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Acquiring lock "cinder-quobyte-956bf248-e79d-4b3c-96b6-a8d7925f4583" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Lock "cinder-quobyte-956bf248-e79d-4b3c-96b6-a8d7925f4583" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[013a404e-aae8-4541-9e1d-63082b88ddef]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-956bf248-e79d-4b3c-96b6-a8d7925f4583 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Flow 'volume_create_manager' (cff70cad-2afa-4ba1-85da-095e4b82f2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20b894a-f604-4c3f-99be-364ad793ffe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e20b894a-f604-4c3f-99be-364ad793ffe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1085062737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ff23d2-b270-4ed1-8b4d-258861313ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bf422460f84bf4806f29c400ec7798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:21Z,use_quota=True,user_id='bc83fe06af8340eab7f71f8c78b0b0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c4a9e4-d20a-4f6d-a633-4d671b4d97f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c4a9e4-d20a-4f6d-a633-4d671b4d97f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9910ba4-48ff-4355-8b45-b544c0009c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9910ba4-48ff-4355-8b45-b544c0009c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73ff23d2-b270-4ed1-8b4d-258861313ebb', 'volume_name': 'volume-73ff23d2-b270-4ed1-8b4d-258861313ebb', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619c50f9-9e5b-4b5b-9f08-31c092ee18c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619c50f9-9e5b-4b5b-9f08-31c092ee18c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788fcdad-14b8-4811-8457-fd8f2d2df7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:21 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Volume 73ff23d2-b270-4ed1-8b4d-258861313ebb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73ff23d2-b270-4ed1-8b4d-258861313ebb', 'volume_size': 1} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1085062737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73ff23d2-b270-4ed1-8b4d-258861313ebb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bf422460f84bf4806f29c400ec7798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:21Z,use_quota=True,user_id='bc83fe06af8340eab7f71f8c78b0b0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Creating volume 73ff23d2-b270-4ed1-8b4d-258861313ebb {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:21 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-73ff23d2-b270-4ed1-8b4d-258861313ebb 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:21 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-73ff23d2-b270-4ed1-8b4d-258861313ebb 1073741824 Sep 04 19:12:21 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:21 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-956bf248-e79d-4b3c-96b6-a8d7925f4583 Sep 04 19:12:21 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Flow 'volume_create_manager' (854a4780-1b02-4507-a898-f878b013268e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f494bd-60dc-402b-94fe-bda0e6844196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69f494bd-60dc-402b-94fe-bda0e6844196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1888770233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf1a140f-b37c-4871-ada5-f4b08a3d5b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bf422460f84bf4806f29c400ec7798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:22Z,use_quota=True,user_id='bc83fe06af8340eab7f71f8c78b0b0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffc5b65-9611-4e73-b725-e92fef300df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffc5b65-9611-4e73-b725-e92fef300df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5962629e-15f3-4364-9c7d-9cdfc7c70b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5962629e-15f3-4364-9c7d-9cdfc7c70b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf1a140f-b37c-4871-ada5-f4b08a3d5b5a', 'volume_name': 'volume-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82964490-4fe4-453a-8323-2f3c56714886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82964490-4fe4-453a-8323-2f3c56714886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39d245a-397c-490a-a9ff-31ac7466621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:22 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Volume cf1a140f-b37c-4871-ada5-f4b08a3d5b5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a', 'volume_size': 1} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:22 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-956bf248-e79d-4b3c-96b6-a8d7925f4583" returned: 0 in 0.757s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-956bf248-e79d-4b3c-96b6-a8d7925f4583 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:22 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-956bf248-e79d-4b3c-96b6-a8d7925f4583 Sep 04 19:12:22 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:22 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-73ff23d2-b270-4ed1-8b4d-258861313ebb 1073741824" returned: 0 in 0.913s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Flow 'volume_create_manager' (3e23be42-7334-4c59-9ec6-0aa969e5910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:22 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737f89f2-6899-4d41-a109-900ee7c03b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-956bf248-e79d-4b3c-96b6-a8d7925f4583" returned: 0 in 0.396s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737f89f2-6899-4d41-a109-900ee7c03b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1910701143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a333d546-d8a0-4050-888a-50107175fb90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bf422460f84bf4806f29c400ec7798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:23Z,use_quota=True,user_id='bc83fe06af8340eab7f71f8c78b0b0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a808b8d-87f2-4ee3-86b7-a01174070255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a808b8d-87f2-4ee3-86b7-a01174070255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486eebbe-2731-4b4f-8c25-4d4094942f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (486eebbe-2731-4b4f-8c25-4d4094942f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a333d546-d8a0-4050-888a-50107175fb90', 'volume_name': 'volume-a333d546-d8a0-4050-888a-50107175fb90', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a27681-52b8-4796-a4f1-25a209207da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55a27681-52b8-4796-a4f1-25a209207da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5a61e2-83e5-4e97-820f-7cab854ea340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:22 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Volume a333d546-d8a0-4050-888a-50107175fb90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a333d546-d8a0-4050-888a-50107175fb90', 'volume_size': 1} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Lock "cinder-quobyte-956bf248-e79d-4b3c-96b6-a8d7925f4583" released by "delete_volume" :: held 1.277s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Acquiring lock "cinder-quobyte-e0a01489-0870-4f1b-ba72-60914da62377" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-73ff23d2-b270-4ed1-8b4d-258861313ebb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Lock "cinder-quobyte-e0a01489-0870-4f1b-ba72-60914da62377" acquired by "delete_volume" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:22 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-73ff23d2-b270-4ed1-8b4d-258861313ebb Sep 04 19:12:22 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5f6253-430a-43d2-bab0-6d21c2de09da]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e0a01489-0870-4f1b-ba72-60914da62377 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:23 devstack sudo[97209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e0a01489-0870-4f1b-ba72-60914da62377 Sep 04 19:12:23 devstack sudo[97209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:23 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-73ff23d2-b270-4ed1-8b4d-258861313ebb" returned: 0 in 0.616s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] <== create_volume: return (1727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.152s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1888770233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf1a140f-b37c-4871-ada5-f4b08a3d5b5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bf422460f84bf4806f29c400ec7798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:22Z,use_quota=True,user_id='bc83fe06af8340eab7f71f8c78b0b0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Creating volume cf1a140f-b37c-4871-ada5-f4b08a3d5b5a {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:23 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:23 devstack sudo[97209]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e0a01489-0870-4f1b-ba72-60914da62377" returned: 0 in 0.613s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (788fcdad-14b8-4811-8457-fd8f2d2df7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73ff23d2-b270-4ed1-8b4d-258861313ebb', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b017ab1-051c-4926-8929-df88ec9f5308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:23 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a 1073741824 Sep 04 19:12:23 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e0a01489-0870-4f1b-ba72-60914da62377 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:23 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e0a01489-0870-4f1b-ba72-60914da62377 Sep 04 19:12:23 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:23 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Volume volume-73ff23d2-b270-4ed1-8b4d-258861313ebb (73ff23d2-b270-4ed1-8b4d-258861313ebb): created successfully Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b017ab1-051c-4926-8929-df88ec9f5308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Flow 'volume_create_manager' (cff70cad-2afa-4ba1-85da-095e4b82f2b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Flow 'volume_create_manager' (da607afa-c41a-44a3-9119-30999671846b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9658c01-5ea3-481e-a6e0-d53c753f3755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9658c01-5ea3-481e-a6e0-d53c753f3755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1735185867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e252e8b-41cc-4567-8f7d-d73647021349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bf422460f84bf4806f29c400ec7798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:23Z,use_quota=True,user_id='bc83fe06af8340eab7f71f8c78b0b0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9d860a-47c4-448b-9ff5-4eb165dc9446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9d860a-47c4-448b-9ff5-4eb165dc9446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7297b5d0-469c-4133-9c8f-541a19ae38dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7297b5d0-469c-4133-9c8f-541a19ae38dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e252e8b-41cc-4567-8f7d-d73647021349', 'volume_name': 'volume-7e252e8b-41cc-4567-8f7d-d73647021349', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65eca9e-dac0-4820-b7d3-1d07db6028cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b65eca9e-dac0-4820-b7d3-1d07db6028cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf296b3-530b-46c2-acab-eca0df267422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:23 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Volume 7e252e8b-41cc-4567-8f7d-d73647021349: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e252e8b-41cc-4567-8f7d-d73647021349', 'volume_size': 1} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:23 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1b77563c-1a01-4504-8abd-c75d383e4905 tempest-CreateVolumesFromImageTest-1347666029 None] Created volume successfully. Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Flow 'volume_create_manager' (e96cb356-9cb1-4c2c-a430-73cccb64da38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c798d35c-8c7a-4fe7-b7d2-7a476df113b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c798d35c-8c7a-4fe7-b7d2-7a476df113b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-588747439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8414b5-5968-42bd-99e6-01003a054093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bf422460f84bf4806f29c400ec7798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:24Z,use_quota=True,user_id='bc83fe06af8340eab7f71f8c78b0b0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3e1796-1909-4dba-8475-d16c23543c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3e1796-1909-4dba-8475-d16c23543c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe75cc4-3896-420f-aff0-fb68c218ff80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fe75cc4-3896-420f-aff0-fb68c218ff80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac8414b5-5968-42bd-99e6-01003a054093', 'volume_name': 'volume-ac8414b5-5968-42bd-99e6-01003a054093', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568f5a6c-41d7-4ea0-8c97-740de4c87cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (568f5a6c-41d7-4ea0-8c97-740de4c87cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992d7fcf-4d65-41e0-933d-f08da5e9c4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:23 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Volume ac8414b5-5968-42bd-99e6-01003a054093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac8414b5-5968-42bd-99e6-01003a054093', 'volume_size': 1} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:23 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e0a01489-0870-4f1b-ba72-60914da62377" returned: 0 in 0.481s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Lock "cinder-quobyte-e0a01489-0870-4f1b-ba72-60914da62377" released by "delete_volume" :: held 1.184s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Created reservations ['76ab724c-ac65-4710-a968-62bc2276cf53'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:24 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a 1073741824" returned: 0 in 0.788s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:24 devstack cinder-volume[87560]: WARNING cinder.quota [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-989796044 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-989796044, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:12:24 devstack cinder-volume[87560]: WARNING cinder.quota [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-989796044 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-989796044, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Created reservations ['0273de62-2722-42a1-9b61-9da2f260eb10', '7c192e0a-c7ce-42a4-83e3-c9248783e6d3', '192020d0-5c01-4405-9620-b422f53df3aa', '98a63d2e-dbf4-4266-b994-02c8852a0043'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:24 devstack sudo[97224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a Sep 04 19:12:24 devstack sudo[97224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Created reservations ['3cc15817-0d90-46f4-960f-820a46c153c8', '1bc841ce-5c5d-4235-9e8f-4946f1201a8d', '011cd9fb-3eaf-439d-b280-cb0407a58fa7', '69df42c0-3844-4d5b-b83b-adf9b93fd6e0'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:24 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:24 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:24 devstack sudo[97224]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a" returned: 0 in 0.364s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] <== create_volume: return (1226ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.894s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1910701143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a333d546-d8a0-4050-888a-50107175fb90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bf422460f84bf4806f29c400ec7798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:23Z,use_quota=True,user_id='bc83fe06af8340eab7f71f8c78b0b0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Creating volume a333d546-d8a0-4050-888a-50107175fb90 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:24 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a333d546-d8a0-4050-888a-50107175fb90 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e39d245a-397c-490a-a9ff-31ac7466621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec674af0-bc34-4525-aac9-52e54d370d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:24 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a333d546-d8a0-4050-888a-50107175fb90 1073741824 Sep 04 19:12:24 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Volume volume-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a (cf1a140f-b37c-4871-ada5-f4b08a3d5b5a): created successfully Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec674af0-bc34-4525-aac9-52e54d370d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Flow 'volume_create_manager' (854a4780-1b02-4507-a898-f878b013268e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6f89cee3-94fe-4d62-be17-da004e71d6ef tempest-CreateVolumesFromImageTest-1347666029 None] Created volume successfully. Sep 04 19:12:24 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.373s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:24 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f09b61c5-54df-4fb7-9ba8-a132db6cedd9 tempest-GroupsTest-1906909718 None] Delete group completed successfully. Sep 04 19:12:25 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a333d546-d8a0-4050-888a-50107175fb90 1073741824" returned: 0 in 0.578s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a333d546-d8a0-4050-888a-50107175fb90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:25 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a333d546-d8a0-4050-888a-50107175fb90 Sep 04 19:12:25 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:25 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a333d546-d8a0-4050-888a-50107175fb90" returned: 0 in 0.272s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.883s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1735185867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e252e8b-41cc-4567-8f7d-d73647021349,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bf422460f84bf4806f29c400ec7798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:23Z,use_quota=True,user_id='bc83fe06af8340eab7f71f8c78b0b0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Creating volume 7e252e8b-41cc-4567-8f7d-d73647021349 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:25 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7e252e8b-41cc-4567-8f7d-d73647021349 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5a61e2-83e5-4e97-820f-7cab854ea340) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a333d546-d8a0-4050-888a-50107175fb90', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:25 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7e252e8b-41cc-4567-8f7d-d73647021349 1073741824 Sep 04 19:12:25 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e86cc7-601e-413a-bd92-d6827f1ef03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:25 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Volume volume-a333d546-d8a0-4050-888a-50107175fb90 (a333d546-d8a0-4050-888a-50107175fb90): created successfully Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e86cc7-601e-413a-bd92-d6827f1ef03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Flow 'volume_create_manager' (3e23be42-7334-4c59-9ec6-0aa969e5910d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d59827e9-2853-46fa-a2d3-8861fc0a6453 tempest-CreateVolumesFromImageTest-1347666029 None] Created volume successfully. Sep 04 19:12:26 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7e252e8b-41cc-4567-8f7d-d73647021349 1073741824" returned: 0 in 0.543s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7e252e8b-41cc-4567-8f7d-d73647021349 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:26 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7e252e8b-41cc-4567-8f7d-d73647021349 Sep 04 19:12:26 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:26 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7e252e8b-41cc-4567-8f7d-d73647021349" returned: 0 in 0.355s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.570s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-588747439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac8414b5-5968-42bd-99e6-01003a054093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52bf422460f84bf4806f29c400ec7798',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:24Z,use_quota=True,user_id='bc83fe06af8340eab7f71f8c78b0b0d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Creating volume ac8414b5-5968-42bd-99e6-01003a054093 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:26 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac8414b5-5968-42bd-99e6-01003a054093 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bf296b3-530b-46c2-acab-eca0df267422) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e252e8b-41cc-4567-8f7d-d73647021349', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:26 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac8414b5-5968-42bd-99e6-01003a054093 1073741824 Sep 04 19:12:26 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b575be7d-5359-4497-bdd9-0b53a6f885d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:26 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Volume volume-7e252e8b-41cc-4567-8f7d-d73647021349 (7e252e8b-41cc-4567-8f7d-d73647021349): created successfully Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b575be7d-5359-4497-bdd9-0b53a6f885d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Flow 'volume_create_manager' (da607afa-c41a-44a3-9119-30999671846b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-01438483-f278-4edd-8eb2-93236c27904d tempest-CreateVolumesFromImageTest-1347666029 None] Created volume successfully. Sep 04 19:12:27 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac8414b5-5968-42bd-99e6-01003a054093 1073741824" returned: 0 in 0.612s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac8414b5-5968-42bd-99e6-01003a054093 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:27 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac8414b5-5968-42bd-99e6-01003a054093 Sep 04 19:12:27 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:27 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac8414b5-5968-42bd-99e6-01003a054093" returned: 0 in 0.383s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992d7fcf-4d65-41e0-933d-f08da5e9c4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac8414b5-5968-42bd-99e6-01003a054093', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63150dcc-1036-42b6-8c42-a1fba9fae11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:27 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Volume volume-ac8414b5-5968-42bd-99e6-01003a054093 (ac8414b5-5968-42bd-99e6-01003a054093): created successfully Sep 04 19:12:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63150dcc-1036-42b6-8c42-a1fba9fae11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Flow 'volume_create_manager' (e96cb356-9cb1-4c2c-a430-73cccb64da38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:27 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e78f3493-2895-4b50-b991-d6bedafa7bf5 tempest-CreateVolumesFromImageTest-1347666029 None] Created volume successfully. Sep 04 19:12:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "cinder-ac8414b5-5968-42bd-99e6-01003a054093-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-ac8414b5-5968-42bd-99e6-01003a054093-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "cinder-quobyte-ac8414b5-5968-42bd-99e6-01003a054093" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-quobyte-ac8414b5-5968-42bd-99e6-01003a054093" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ffa60c-f3f2-4bb8-909d-61337a9daad1]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac8414b5-5968-42bd-99e6-01003a054093 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:28 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac8414b5-5968-42bd-99e6-01003a054093 Sep 04 19:12:28 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:28 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac8414b5-5968-42bd-99e6-01003a054093" returned: 0 in 0.457s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac8414b5-5968-42bd-99e6-01003a054093 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:28 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac8414b5-5968-42bd-99e6-01003a054093 Sep 04 19:12:28 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:29 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ac8414b5-5968-42bd-99e6-01003a054093" returned: 0 in 0.309s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-quobyte-ac8414b5-5968-42bd-99e6-01003a054093" released by "delete_volume" :: held 0.827s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Created reservations ['d2242319-250d-4fb2-a06e-2e29be5a5c2c', 'fba74a74-e786-4b7a-b111-4cafe51bb719', '9c787899-5412-4422-9986-9a1ae0382b21', '34a85b21-c97e-44fd-9c3d-2a6cc718aa0b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:29 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:29 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "cinder-7e252e8b-41cc-4567-8f7d-d73647021349-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-7e252e8b-41cc-4567-8f7d-d73647021349-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "cinder-quobyte-7e252e8b-41cc-4567-8f7d-d73647021349" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-quobyte-7e252e8b-41cc-4567-8f7d-d73647021349" acquired by "delete_volume" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93a3a0d-eb11-4316-a6a4-55c8fc8a7e7e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7e252e8b-41cc-4567-8f7d-d73647021349 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:29 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:29 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7e252e8b-41cc-4567-8f7d-d73647021349 Sep 04 19:12:29 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Flow 'volume_create_manager' (1f74ecf5-8acc-4fd1-95b8-d64fd4e68b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05821c38-670b-40f8-89e8-fd24db934ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.433s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Deleted volume successfully. Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05821c38-670b-40f8-89e8-fd24db934ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-605161168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a45ae74-aeff-4271-b93f-957d60db204a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e626d5a6032741eab820e4c5874cb0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:30Z,use_quota=True,user_id='a921cda6f95c4c498093e91deb6588aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5794a7-2bfb-4526-9b01-4de9179fb2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d5794a7-2bfb-4526-9b01-4de9179fb2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3ec945-9c28-4d49-9de7-4abcbff9e26d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3ec945-9c28-4d49-9de7-4abcbff9e26d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a45ae74-aeff-4271-b93f-957d60db204a', 'volume_name': 'volume-3a45ae74-aeff-4271-b93f-957d60db204a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1dcd47-1129-4519-b6c5-82f68f309215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1dcd47-1129-4519-b6c5-82f68f309215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25f7988-d0c1-42bb-bf41-4a692c619121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:29 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Volume 3a45ae74-aeff-4271-b93f-957d60db204a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a45ae74-aeff-4271-b93f-957d60db204a', 'volume_size': 1} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-605161168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a45ae74-aeff-4271-b93f-957d60db204a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e626d5a6032741eab820e4c5874cb0c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:30Z,use_quota=True,user_id='a921cda6f95c4c498093e91deb6588aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Creating volume 3a45ae74-aeff-4271-b93f-957d60db204a {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:29 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3a45ae74-aeff-4271-b93f-957d60db204a 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d4d26be4-e3d8-41bf-afb7-edec210aa6be tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-ac8414b5-5968-42bd-99e6-01003a054093-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:30 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3a45ae74-aeff-4271-b93f-957d60db204a 1073741824 Sep 04 19:12:30 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:30 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7e252e8b-41cc-4567-8f7d-d73647021349" returned: 0 in 0.473s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7e252e8b-41cc-4567-8f7d-d73647021349 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:30 devstack sudo[97313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7e252e8b-41cc-4567-8f7d-d73647021349 Sep 04 19:12:30 devstack sudo[97313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:30 devstack sudo[97313]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7e252e8b-41cc-4567-8f7d-d73647021349" returned: 0 in 0.279s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-quobyte-7e252e8b-41cc-4567-8f7d-d73647021349" released by "delete_volume" :: held 0.803s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Created reservations ['ab0ae58b-06d1-4c09-9d32-ac479d31a0fa', 'b1735f3d-394a-48b8-97ac-7e85eb008238', '7714c369-1060-4ca1-8c41-1d984613951a', '4563e4b9-d7bf-45ad-85f5-f955edc34008'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:30 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3a45ae74-aeff-4271-b93f-957d60db204a 1073741824" returned: 0 in 0.622s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3a45ae74-aeff-4271-b93f-957d60db204a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:30 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:30 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:30 devstack sudo[97321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3a45ae74-aeff-4271-b93f-957d60db204a Sep 04 19:12:30 devstack sudo[97321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "cinder-a333d546-d8a0-4050-888a-50107175fb90-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-a333d546-d8a0-4050-888a-50107175fb90-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "cinder-quobyte-a333d546-d8a0-4050-888a-50107175fb90" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-quobyte-a333d546-d8a0-4050-888a-50107175fb90" acquired by "delete_volume" :: waited 0.045s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff31a6b9-3bee-49e9-8cfc-719775b06b0c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a333d546-d8a0-4050-888a-50107175fb90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:31 devstack sudo[97321]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3a45ae74-aeff-4271-b93f-957d60db204a" returned: 0 in 0.366s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a25f7988-d0c1-42bb-bf41-4a692c619121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a45ae74-aeff-4271-b93f-957d60db204a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1764491-584d-4812-8b04-dfd7b5d9989c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:31 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Volume volume-3a45ae74-aeff-4271-b93f-957d60db204a (3a45ae74-aeff-4271-b93f-957d60db204a): created successfully Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1764491-584d-4812-8b04-dfd7b5d9989c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Flow 'volume_create_manager' (1f74ecf5-8acc-4fd1-95b8-d64fd4e68b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4897dec0-d93e-4967-a61c-6560bb9d8f1d tempest-AbsoluteLimitsTests-1909942687 None] Created volume successfully. Sep 04 19:12:31 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a333d546-d8a0-4050-888a-50107175fb90 Sep 04 19:12:31 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:31 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.512s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Deleted volume successfully. Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-73ada5ff-4ab0-4a60-8866-40629c383422 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-7e252e8b-41cc-4567-8f7d-d73647021349-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:31 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a333d546-d8a0-4050-888a-50107175fb90" returned: 0 in 0.416s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a333d546-d8a0-4050-888a-50107175fb90 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:31 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a333d546-d8a0-4050-888a-50107175fb90 Sep 04 19:12:31 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:31 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a333d546-d8a0-4050-888a-50107175fb90" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-quobyte-a333d546-d8a0-4050-888a-50107175fb90" released by "delete_volume" :: held 0.745s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Created reservations ['3fb7412d-6a5d-4512-9b61-ca86e40e475c', 'dd2df4a7-7f64-4047-9993-184c9f9783ac', 'cf379585-1602-417a-8ae4-dadd3c6a0065', 'e4aecd6d-3a84-435f-ab10-a710d77ac998'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:31 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:31 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "cinder-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:32 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.360s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Deleted volume successfully. Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Acquiring lock "cinder-3a45ae74-aeff-4271-b93f-957d60db204a-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96004241-b72b-429d-b907-761177a3f872 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-a333d546-d8a0-4050-888a-50107175fb90-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "cinder-quobyte-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Lock "cinder-3a45ae74-aeff-4271-b93f-957d60db204a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-quobyte-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2f6ac1-c902-4d59-889b-096a0a9c324e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Acquiring lock "cinder-quobyte-3a45ae74-aeff-4271-b93f-957d60db204a" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Lock "cinder-quobyte-3a45ae74-aeff-4271-b93f-957d60db204a" acquired by "delete_volume" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[080e13b4-421e-473c-9fce-2f0972f19f98]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3a45ae74-aeff-4271-b93f-957d60db204a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:32 devstack sudo[97338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a Sep 04 19:12:32 devstack sudo[97338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:32 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3a45ae74-aeff-4271-b93f-957d60db204a Sep 04 19:12:32 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-10ea1f27-63f9-413d-b178-d78a2709ce54 tempest-GroupsV320Test-2143144875 None] Group tempest-GroupsV320Test-Group-1001563959: creating Sep 04 19:12:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-10ea1f27-63f9-413d-b178-d78a2709ce54 tempest-GroupsV320Test-2143144875 None] Group tempest-GroupsV320Test-Group-1001563959: created successfully Sep 04 19:12:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-10ea1f27-63f9-413d-b178-d78a2709ce54 tempest-GroupsV320Test-2143144875 None] Create group completed successfully. Sep 04 19:12:32 devstack sudo[97338]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a" returned: 0 in 0.412s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:32 devstack sudo[97346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a Sep 04 19:12:32 devstack sudo[97346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:32 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3a45ae74-aeff-4271-b93f-957d60db204a" returned: 0 in 0.433s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3a45ae74-aeff-4271-b93f-957d60db204a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:32 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3a45ae74-aeff-4271-b93f-957d60db204a Sep 04 19:12:32 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:33 devstack sudo[97346]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a" returned: 0 in 0.283s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-quobyte-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a" released by "delete_volume" :: held 0.759s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Created reservations ['c3a18ea6-a1f1-4809-8713-d8b4cfa6f58d', '04bbc9bb-5211-4700-b2a7-0df38d71311c', '677564c6-75b8-4373-94d7-5a28fcfeb8af', '1e64931a-28f0-46c8-85d4-0288a0420683'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:33 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3a45ae74-aeff-4271-b93f-957d60db204a" returned: 0 in 0.307s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Lock "cinder-quobyte-3a45ae74-aeff-4271-b93f-957d60db204a" released by "delete_volume" :: held 0.804s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:33 devstack sudo[97355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:33 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Created reservations ['7ecb52a5-ee24-454b-849b-6c50eeb47751', 'cb25b065-f3aa-4b46-ba9d-8a542e7412ed', 'e20b7a54-b63d-40f2-9877-c2ac9a60fd73', 'b3c34c91-c536-4626-8d94-8ade629bb0f6'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "cinder-73ff23d2-b270-4ed1-8b4d-258861313ebb-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-73ff23d2-b270-4ed1-8b4d-258861313ebb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "cinder-quobyte-73ff23d2-b270-4ed1-8b4d-258861313ebb" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:33 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:33 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-quobyte-73ff23d2-b270-4ed1-8b4d-258861313ebb" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[537894a8-7f30-4426-a635-3bdf3e1f5f27]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-73ff23d2-b270-4ed1-8b4d-258861313ebb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:33 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.343s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:33 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Deleted volume successfully. Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fcaeae0b-cca5-4621-8703-dced5ed8adc2 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-cf1a140f-b37c-4871-ada5-f4b08a3d5b5a-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:33 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-73ff23d2-b270-4ed1-8b4d-258861313ebb Sep 04 19:12:33 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:33 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.370s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:33 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Deleted volume successfully. Sep 04 19:12:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aa929a27-a94e-4dad-8650-3f6954ce7950 tempest-AbsoluteLimitsTests-1909942687 None] Lock "cinder-3a45ae74-aeff-4271-b93f-957d60db204a-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:34 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-73ff23d2-b270-4ed1-8b4d-258861313ebb" returned: 0 in 0.534s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-73ff23d2-b270-4ed1-8b4d-258861313ebb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:34 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-73ff23d2-b270-4ed1-8b4d-258861313ebb Sep 04 19:12:34 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ce66c9a1-382c-4ce3-abda-121edf077ead tempest-GroupsV320Test-2143144875 None] Created reservations ['76f81bb6-7ca2-4bf4-83d9-b8e5ed18dbb4'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:34 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-73ff23d2-b270-4ed1-8b4d-258861313ebb" returned: 0 in 0.386s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-quobyte-73ff23d2-b270-4ed1-8b4d-258861313ebb" released by "delete_volume" :: held 0.987s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ce66c9a1-382c-4ce3-abda-121edf077ead tempest-GroupsV320Test-2143144875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ce66c9a1-382c-4ce3-abda-121edf077ead tempest-GroupsV320Test-2143144875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ce66c9a1-382c-4ce3-abda-121edf077ead tempest-GroupsV320Test-2143144875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ce66c9a1-382c-4ce3-abda-121edf077ead tempest-GroupsV320Test-2143144875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ce66c9a1-382c-4ce3-abda-121edf077ead tempest-GroupsV320Test-2143144875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ce66c9a1-382c-4ce3-abda-121edf077ead tempest-GroupsV320Test-2143144875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:34 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:34 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Created reservations ['3c7f1586-8a35-4d89-ad7e-0004de86da37', 'e6958b23-03f5-4742-9b47-4fbca80b509d', 'd4673004-553a-4472-b77c-ad99900f4087', '9bcb4aa9-f5e0-4b7a-92fa-3cf63c891848'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:34 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:34 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:34 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ce66c9a1-382c-4ce3-abda-121edf077ead tempest-GroupsV320Test-2143144875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.309s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-ce66c9a1-382c-4ce3-abda-121edf077ead tempest-GroupsV320Test-2143144875 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ce66c9a1-382c-4ce3-abda-121edf077ead tempest-GroupsV320Test-2143144875 None] Delete group completed successfully. Sep 04 19:12:34 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.282s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:34 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Deleted volume successfully. Sep 04 19:12:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-629f2ae0-3a58-4a54-bcc0-aefa4a100d36 tempest-CreateVolumesFromImageTest-1347666029 None] Lock "cinder-73ff23d2-b270-4ed1-8b4d-258861313ebb-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Flow 'volume_create_manager' (602de6b8-5aa7-4cfe-90c5-36ed5c2ff2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61e22f1-1f15-4f44-8210-8abc05cf2788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a61e22f1-1f15-4f44-8210-8abc05cf2788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2092960975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a72549aa-b7b2-4bd0-abf8-7f04aea4014a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724580734be8480aa8510fcdb6c7a7a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:41Z,use_quota=True,user_id='70674cc3987e4274bf32de81f4d16b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e58695-94b5-4bf1-8293-c0d6307ed394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e58695-94b5-4bf1-8293-c0d6307ed394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e42bf6-3cc7-4eb0-bcd3-aa65518579fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44e42bf6-3cc7-4eb0-bcd3-aa65518579fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a72549aa-b7b2-4bd0-abf8-7f04aea4014a', 'volume_name': 'volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7336148d-6d74-498d-9658-2217e586c188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7336148d-6d74-498d-9658-2217e586c188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70bf7fb7-3e1f-4689-84b5-5af95339fd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:41 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Volume a72549aa-b7b2-4bd0-abf8-7f04aea4014a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a', 'volume_size': 1} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2092960975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a72549aa-b7b2-4bd0-abf8-7f04aea4014a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='724580734be8480aa8510fcdb6c7a7a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:41Z,use_quota=True,user_id='70674cc3987e4274bf32de81f4d16b4c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Creating volume a72549aa-b7b2-4bd0-abf8-7f04aea4014a {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:41 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:41 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a 1073741824 Sep 04 19:12:41 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:42 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a 1073741824" returned: 0 in 0.577s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:42 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a Sep 04 19:12:42 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:42 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" returned: 0 in 0.352s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70bf7fb7-3e1f-4689-84b5-5af95339fd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0056332-919f-41c5-bd7b-046a7c6c0075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:42 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Volume volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a (a72549aa-b7b2-4bd0-abf8-7f04aea4014a): created successfully Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0056332-919f-41c5-bd7b-046a7c6c0075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Flow 'volume_create_manager' (602de6b8-5aa7-4cfe-90c5-36ed5c2ff2eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-470b2fe4-526a-4e99-a511-25c7e1b4a4ff tempest-VolumesActionsTest-1082017113 None] Created volume successfully. Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Flow 'volume_create_manager' (b7b410b2-ef13-43fa-9b35-ff63848801cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17fcbe9-5646-47d4-95a3-79959a7f879f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17fcbe9-5646-47d4-95a3-79959a7f879f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1724236083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734c4180-212f-4e55-8bf9-2d4b8fd7b996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c89562392245d38dbe3a1b56e280d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:43Z,use_quota=True,user_id='a01dfdd3da9841b8b81b63dc0ca68162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82b4bb6-20bf-4a9b-80eb-1a7b8e7edde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82b4bb6-20bf-4a9b-80eb-1a7b8e7edde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c369a5-8fd0-446f-8877-f01aae299c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c369a5-8fd0-446f-8877-f01aae299c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '734c4180-212f-4e55-8bf9-2d4b8fd7b996', 'volume_name': 'volume-734c4180-212f-4e55-8bf9-2d4b8fd7b996', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a011fa3-3555-4491-9aba-1195ac4ddbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a011fa3-3555-4491-9aba-1195ac4ddbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582205b1-3556-44e6-8b4c-03a36c17a4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:42 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Volume 734c4180-212f-4e55-8bf9-2d4b8fd7b996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-734c4180-212f-4e55-8bf9-2d4b8fd7b996', 'volume_size': 1} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1724236083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=734c4180-212f-4e55-8bf9-2d4b8fd7b996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='76c89562392245d38dbe3a1b56e280d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:43Z,use_quota=True,user_id='a01dfdd3da9841b8b81b63dc0ca68162',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Creating volume 734c4180-212f-4e55-8bf9-2d4b8fd7b996 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:42 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-734c4180-212f-4e55-8bf9-2d4b8fd7b996 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:42 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-734c4180-212f-4e55-8bf9-2d4b8fd7b996 1073741824 Sep 04 19:12:42 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:43 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-734c4180-212f-4e55-8bf9-2d4b8fd7b996 1073741824" returned: 0 in 0.615s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-734c4180-212f-4e55-8bf9-2d4b8fd7b996 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:43 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-734c4180-212f-4e55-8bf9-2d4b8fd7b996 Sep 04 19:12:43 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:43 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-734c4180-212f-4e55-8bf9-2d4b8fd7b996" returned: 0 in 0.329s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582205b1-3556-44e6-8b4c-03a36c17a4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-734c4180-212f-4e55-8bf9-2d4b8fd7b996', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518f0217-be53-42b1-993a-67ef08127f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:43 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Volume volume-734c4180-212f-4e55-8bf9-2d4b8fd7b996 (734c4180-212f-4e55-8bf9-2d4b8fd7b996): created successfully Sep 04 19:12:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (518f0217-be53-42b1-993a-67ef08127f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Flow 'volume_create_manager' (b7b410b2-ef13-43fa-9b35-ff63848801cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a340bad0-fa50-49dc-a005-618151d393e4 tempest-VolumesMetadataTest-1265511762 None] Created volume successfully. Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:45 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:45 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:45 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.409s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Acquiring lock "cinder-734c4180-212f-4e55-8bf9-2d4b8fd7b996-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Lock "cinder-734c4180-212f-4e55-8bf9-2d4b8fd7b996-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Acquiring lock "cinder-quobyte-734c4180-212f-4e55-8bf9-2d4b8fd7b996" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Lock "cinder-quobyte-734c4180-212f-4e55-8bf9-2d4b8fd7b996" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba579ebe-6859-4348-a8a9-982086faf990]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-734c4180-212f-4e55-8bf9-2d4b8fd7b996 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:46 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-734c4180-212f-4e55-8bf9-2d4b8fd7b996 Sep 04 19:12:46 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:46 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-734c4180-212f-4e55-8bf9-2d4b8fd7b996" returned: 0 in 0.510s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-734c4180-212f-4e55-8bf9-2d4b8fd7b996 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:46 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-734c4180-212f-4e55-8bf9-2d4b8fd7b996 Sep 04 19:12:46 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:46 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-734c4180-212f-4e55-8bf9-2d4b8fd7b996" returned: 0 in 0.396s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Lock "cinder-quobyte-734c4180-212f-4e55-8bf9-2d4b8fd7b996" released by "delete_volume" :: held 0.983s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:47 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Created reservations ['4161ac5f-c5ee-4d6d-bf98-59e8b71adbb8', '2afa95f2-c25e-47e4-ac59-3472b48c98d3', 'fa51eb59-4e4f-4450-b16a-c9cd65fd975c', '65e53b51-9763-4740-aa2a-ac5606eb7643'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:47 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:47 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:47 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.536s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:47 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Deleted volume successfully. Sep 04 19:12:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7f930c78-0737-401d-b6c9-4a6386acd62e tempest-VolumesMetadataTest-1265511762 None] Lock "cinder-734c4180-212f-4e55-8bf9-2d4b8fd7b996-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Flow 'volume_create_manager' (509d2a98-bd4b-47d2-bdfa-ec7c2cb32ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f664bc34-c42a-4853-9487-efcf12ada78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f664bc34-c42a-4853-9487-efcf12ada78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-777903543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8a91ae-75d6-4fe5-9bf6-50af50026551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46755c9c22a4b9da3a2c1442c94f517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:50Z,use_quota=True,user_id='2e98dcd9d6b64b63a13d1884418a5a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa5db92-d406-4ed7-bb55-04717f31e8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfa5db92-d406-4ed7-bb55-04717f31e8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70774504-f441-42f5-8a85-7d4ea930d3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70774504-f441-42f5-8a85-7d4ea930d3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f8a91ae-75d6-4fe5-9bf6-50af50026551', 'volume_name': 'volume-3f8a91ae-75d6-4fe5-9bf6-50af50026551', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e53bcce-0c9f-4728-9303-b6f67d1165ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e53bcce-0c9f-4728-9303-b6f67d1165ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ba1e64-8c0a-4a64-935f-8658aaa36def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:49 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Volume 3f8a91ae-75d6-4fe5-9bf6-50af50026551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f8a91ae-75d6-4fe5-9bf6-50af50026551', 'volume_size': 1} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-777903543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f8a91ae-75d6-4fe5-9bf6-50af50026551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46755c9c22a4b9da3a2c1442c94f517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:50Z,use_quota=True,user_id='2e98dcd9d6b64b63a13d1884418a5a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Creating volume 3f8a91ae-75d6-4fe5-9bf6-50af50026551 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:49 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3f8a91ae-75d6-4fe5-9bf6-50af50026551 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:49 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3f8a91ae-75d6-4fe5-9bf6-50af50026551 1073741824 Sep 04 19:12:49 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:50 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3f8a91ae-75d6-4fe5-9bf6-50af50026551 1073741824" returned: 0 in 0.532s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3f8a91ae-75d6-4fe5-9bf6-50af50026551 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:50 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3f8a91ae-75d6-4fe5-9bf6-50af50026551 Sep 04 19:12:50 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:50 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3f8a91ae-75d6-4fe5-9bf6-50af50026551" returned: 0 in 0.401s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7ba1e64-8c0a-4a64-935f-8658aaa36def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f8a91ae-75d6-4fe5-9bf6-50af50026551', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb35762-9802-4ab7-87cb-cccffd01a445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:51 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Volume volume-3f8a91ae-75d6-4fe5-9bf6-50af50026551 (3f8a91ae-75d6-4fe5-9bf6-50af50026551): created successfully Sep 04 19:12:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cb35762-9802-4ab7-87cb-cccffd01a445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Flow 'volume_create_manager' (509d2a98-bd4b-47d2-bdfa-ec7c2cb32ce3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9c6743ba-bd52-4007-aff9-2a8cc9b43f5a tempest-ProjectReaderTests-1495810754 None] Created volume successfully. Sep 04 19:12:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Acquiring lock "cinder-3f8a91ae-75d6-4fe5-9bf6-50af50026551-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Lock "cinder-3f8a91ae-75d6-4fe5-9bf6-50af50026551-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Acquiring lock "cinder-quobyte-3f8a91ae-75d6-4fe5-9bf6-50af50026551" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Lock "cinder-quobyte-3f8a91ae-75d6-4fe5-9bf6-50af50026551" acquired by "delete_volume" :: waited 0.041s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:53 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fc2851-e7c8-46fc-bd79-cd8547785a8e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3f8a91ae-75d6-4fe5-9bf6-50af50026551 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:53 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3f8a91ae-75d6-4fe5-9bf6-50af50026551 Sep 04 19:12:53 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:53 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3f8a91ae-75d6-4fe5-9bf6-50af50026551" returned: 0 in 0.640s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3f8a91ae-75d6-4fe5-9bf6-50af50026551 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:53 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3f8a91ae-75d6-4fe5-9bf6-50af50026551 Sep 04 19:12:53 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:54 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3f8a91ae-75d6-4fe5-9bf6-50af50026551" returned: 0 in 0.461s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Lock "cinder-quobyte-3f8a91ae-75d6-4fe5-9bf6-50af50026551" released by "delete_volume" :: held 1.206s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Created reservations ['4573b48c-0ac9-4b27-b5da-e7487a42a1bc', 'ec5a993d-2a4b-43cf-969c-ed5c441e89bd', '0044b964-82ba-4c4f-b752-477eac2e9746', 'ec5513f2-1548-4e23-891f-9e1287c63be0'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:54 devstack sudo[97525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:54 devstack sudo[97525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f98f3237-6219-4305-906a-2a0368dfe9ef tempest-VolumesActionsTest-1082017113 None] Acquiring lock "cinder-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" by "attach_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f98f3237-6219-4305-906a-2a0368dfe9ef tempest-VolumesActionsTest-1082017113 None] Lock "cinder-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" acquired by "attach_volume" :: waited 0.040s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f98f3237-6219-4305-906a-2a0368dfe9ef tempest-VolumesActionsTest-1082017113 None] Attaching volume a72549aa-b7b2-4bd0-abf8-7f04aea4014a to instance 0343f14a-5c77-4838-854f-e4872f45fd55 at mountpoint /dev/vdb on host None. Sep 04 19:12:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f98f3237-6219-4305-906a-2a0368dfe9ef tempest-VolumesActionsTest-1082017113 None] Attach volume completed successfully. Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f98f3237-6219-4305-906a-2a0368dfe9ef tempest-VolumesActionsTest-1082017113 None] Lock "cinder-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" released by "attach_volume" :: held 0.172s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:54 devstack sudo[97525]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.320s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Deleted volume successfully. Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d7f5a1b0-5fbe-47f0-8d69-b163e1e231d1 tempest-ProjectReaderTests-1495810754 None] Lock "cinder-3f8a91ae-75d6-4fe5-9bf6-50af50026551-delete_volume" released by "delete_volume" :: held 1.882s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-62c77934-05e8-4ac8-8771-b0981115096c tempest-VolumesActionsTest-1082017113 None] Acquiring lock "cinder-a72549aa-b7b2-4bd0-abf8-7f04aea4014a-detach_volume" by "detach_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-62c77934-05e8-4ac8-8771-b0981115096c tempest-VolumesActionsTest-1082017113 None] Lock "cinder-a72549aa-b7b2-4bd0-abf8-7f04aea4014a-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-62c77934-05e8-4ac8-8771-b0981115096c tempest-VolumesActionsTest-1082017113 None] Detaching volume a72549aa-b7b2-4bd0-abf8-7f04aea4014a from instance 0343f14a-5c77-4838-854f-e4872f45fd55. Sep 04 19:12:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-62c77934-05e8-4ac8-8771-b0981115096c tempest-VolumesActionsTest-1082017113 None] Detach volume completed successfully. Sep 04 19:12:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-62c77934-05e8-4ac8-8771-b0981115096c tempest-VolumesActionsTest-1082017113 None] Lock "cinder-a72549aa-b7b2-4bd0-abf8-7f04aea4014a-detach_volume" released by "detach_volume" :: held 0.090s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Flow 'volume_create_manager' (dae61049-c92d-4661-a1e4-81b7afee0ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfd0c5f-a402-452a-984f-1cf0aee9857b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfd0c5f-a402-452a-984f-1cf0aee9857b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1315444555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46755c9c22a4b9da3a2c1442c94f517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:56Z,use_quota=True,user_id='2e98dcd9d6b64b63a13d1884418a5a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb820b1c-cdf4-437a-8416-b2fec9cdb11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb820b1c-cdf4-437a-8416-b2fec9cdb11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef30c1cc-744b-40a1-9b94-b6a3892bbdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef30c1cc-744b-40a1-9b94-b6a3892bbdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e', 'volume_name': 'volume-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88baa311-4843-417c-a748-7b4640e39ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88baa311-4843-417c-a748-7b4640e39ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2e1d7f-5bf3-490b-ab6d-6dc735511c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:56 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Volume eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e', 'volume_size': 1} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1315444555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46755c9c22a4b9da3a2c1442c94f517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:56Z,use_quota=True,user_id='2e98dcd9d6b64b63a13d1884418a5a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Creating volume eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:56 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:56 devstack sudo[97548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e 1073741824 Sep 04 19:12:56 devstack sudo[97548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Flow 'volume_create_manager' (a82b52c6-129c-4579-88e5-5fa4c2fc966a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a4fbc6-7765-48da-ba62-48014802bc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a4fbc6-7765-48da-ba62-48014802bc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-33575824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36170cc7-fa9e-46b9-a754-08b3092d3bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777986c5c91d4384b5afde92c4ce431a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:57Z,use_quota=True,user_id='afed46c321174d8686b64898ff028847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2960f68-6e53-4236-aab4-375ba8eb135a),volume_type_id=c2960f68-6e53-4236-aab4-375ba8eb135a)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:56 devstack sudo[97548]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972f7171-104b-4ee6-b5e2-ecc4271d151f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (972f7171-104b-4ee6-b5e2-ecc4271d151f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e1e53d-235f-4da4-89fb-36d531b9b8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e1e53d-235f-4da4-89fb-36d531b9b8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36170cc7-fa9e-46b9-a754-08b3092d3bd4', 'volume_name': 'volume-36170cc7-fa9e-46b9-a754-08b3092d3bd4', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385af4d0-a079-4dfa-bf25-53dfed14a6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (385af4d0-a079-4dfa-bf25-53dfed14a6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48e3d8b-e89c-4cec-8d2f-1477bb412592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:56 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Volume 36170cc7-fa9e-46b9-a754-08b3092d3bd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36170cc7-fa9e-46b9-a754-08b3092d3bd4', 'volume_size': 1} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e 1073741824" returned: 0 in 0.661s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:56 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e Sep 04 19:12:56 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Flow 'volume_create_manager' (d469a21c-0eb6-4ae4-a5f6-1fb744e9e394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a931b90a-af96-4e00-be83-1cbd442b5112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a931b90a-af96-4e00-be83-1cbd442b5112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1688340577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9231a7ec-bd69-4b3f-9449-6c01c1165841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f8c84551924bcebb845492ef20149e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:57Z,use_quota=True,user_id='3ece8da0945048ff978ddbfe29e2682c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5febaa50-6ac1-4e1e-bf99-85ddc1ed2184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5febaa50-6ac1-4e1e-bf99-85ddc1ed2184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87ea030-3fd5-4050-977a-594738dd51c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87ea030-3fd5-4050-977a-594738dd51c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9231a7ec-bd69-4b3f-9449-6c01c1165841', 'volume_name': 'volume-9231a7ec-bd69-4b3f-9449-6c01c1165841', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b690586-edf1-41d3-af3d-9bd3151cbd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b690586-edf1-41d3-af3d-9bd3151cbd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcae629c-79a1-42a2-a0f8-8c4c233af7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:57 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Volume 9231a7ec-bd69-4b3f-9449-6c01c1165841: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9231a7ec-bd69-4b3f-9449-6c01c1165841', 'volume_size': 1} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:57 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e" returned: 0 in 0.349s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.412s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-33575824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36170cc7-fa9e-46b9-a754-08b3092d3bd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='777986c5c91d4384b5afde92c4ce431a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:57Z,use_quota=True,user_id='afed46c321174d8686b64898ff028847',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c2960f68-6e53-4236-aab4-375ba8eb135a),volume_type_id=c2960f68-6e53-4236-aab4-375ba8eb135a)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Creating volume 36170cc7-fa9e-46b9-a754-08b3092d3bd4 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:57 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36170cc7-fa9e-46b9-a754-08b3092d3bd4 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee2e1d7f-5bf3-490b-ab6d-6dc735511c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0489e288-0883-4ea4-86ec-96a62a385639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:57 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36170cc7-fa9e-46b9-a754-08b3092d3bd4 1073741824 Sep 04 19:12:57 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:57 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Volume volume-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e (eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e): created successfully Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0489e288-0883-4ea4-86ec-96a62a385639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Flow 'volume_create_manager' (dae61049-c92d-4661-a1e4-81b7afee0ed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a9c96f92-b22f-48cd-b962-bacee2255937 tempest-ProjectReaderTests-1495810754 None] Created volume successfully. Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Acquiring lock "cinder-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Lock "cinder-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Acquiring lock "cinder-quobyte-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Lock "cinder-quobyte-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bc0dce-bba2-486d-9381-43da403ecbdc]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:57 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36170cc7-fa9e-46b9-a754-08b3092d3bd4 1073741824" returned: 0 in 0.498s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36170cc7-fa9e-46b9-a754-08b3092d3bd4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:57 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36170cc7-fa9e-46b9-a754-08b3092d3bd4 Sep 04 19:12:57 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:57 devstack sudo[97566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e Sep 04 19:12:57 devstack sudo[97566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:58 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36170cc7-fa9e-46b9-a754-08b3092d3bd4" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1688340577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9231a7ec-bd69-4b3f-9449-6c01c1165841,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f8c84551924bcebb845492ef20149e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:57Z,use_quota=True,user_id='3ece8da0945048ff978ddbfe29e2682c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Creating volume 9231a7ec-bd69-4b3f-9449-6c01c1165841 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:58 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9231a7ec-bd69-4b3f-9449-6c01c1165841 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:58 devstack sudo[97566]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e" returned: 0 in 0.385s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:58 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9231a7ec-bd69-4b3f-9449-6c01c1165841 1073741824 Sep 04 19:12:58 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48e3d8b-e89c-4cec-8d2f-1477bb412592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36170cc7-fa9e-46b9-a754-08b3092d3bd4', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:58 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e Sep 04 19:12:58 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ffe429-d7a8-4b5f-8d0c-3cda05d760c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:58 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Volume volume-36170cc7-fa9e-46b9-a754-08b3092d3bd4 (36170cc7-fa9e-46b9-a754-08b3092d3bd4): created successfully Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79ffe429-d7a8-4b5f-8d0c-3cda05d760c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Flow 'volume_create_manager' (a82b52c6-129c-4579-88e5-5fa4c2fc966a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c247e0a8-d00d-4e53-acf7-90ce9b145596 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Created volume successfully. Sep 04 19:12:58 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e" returned: 0 in 0.280s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Lock "cinder-quobyte-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e" released by "delete_volume" :: held 0.709s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Created reservations ['26618057-acd5-42a2-90e3-86fecf208691', '2961d5db-0bd3-458a-9ed3-be0b1a32abc9', 'e1541ea8-2f36-4d2f-acad-c67becda5cbd', '577b53cd-7dee-493b-a222-060adee44e86'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:58 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:58 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:58 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9231a7ec-bd69-4b3f-9449-6c01c1165841 1073741824" returned: 0 in 0.517s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9231a7ec-bd69-4b3f-9449-6c01c1165841 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:58 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9231a7ec-bd69-4b3f-9449-6c01c1165841 Sep 04 19:12:58 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:58 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.367s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Deleted volume successfully. Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b845446e-b3cb-422a-b84a-ce4d76c44bbb tempest-ProjectReaderTests-1495810754 None] Lock "cinder-eb12a6e8-beb9-4bb1-98a3-4fcaff38fd1e-delete_volume" released by "delete_volume" :: held 1.335s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:12:58 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9231a7ec-bd69-4b3f-9449-6c01c1165841" returned: 0 in 0.303s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:12:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcae629c-79a1-42a2-a0f8-8c4c233af7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9231a7ec-bd69-4b3f-9449-6c01c1165841', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91aa0d5a-bd9c-4563-9710-31589bd5a1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:59 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Volume volume-9231a7ec-bd69-4b3f-9449-6c01c1165841 (9231a7ec-bd69-4b3f-9449-6c01c1165841): created successfully Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91aa0d5a-bd9c-4563-9710-31589bd5a1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Flow 'volume_create_manager' (d469a21c-0eb6-4ae4-a5f6-1fb744e9e394) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9990d3ae-581d-42c0-a3cd-8051410727b1 tempest-VolumesTransfersV355Test-1747945010 None] Created volume successfully. Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9fdafe03-6c95-42b6-889d-6328e8ba1657 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9fdafe03-6c95-42b6-889d-6328e8ba1657 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9fdafe03-6c95-42b6-889d-6328e8ba1657 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9fdafe03-6c95-42b6-889d-6328e8ba1657 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9fdafe03-6c95-42b6-889d-6328e8ba1657 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9fdafe03-6c95-42b6-889d-6328e8ba1657 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:59 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:12:59 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Flow 'volume_create_manager' (2c79d882-a815-4698-b886-9dbc34fadb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003d600a-66ac-4aa9-aab3-392c55e296ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (003d600a-66ac-4aa9-aab3-392c55e296ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1908121597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982682eb-263c-4ffa-aac8-d07168f597a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46755c9c22a4b9da3a2c1442c94f517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:59Z,use_quota=True,user_id='2e98dcd9d6b64b63a13d1884418a5a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fbde19-aaed-41b4-8f17-ce222313a01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81fbde19-aaed-41b4-8f17-ce222313a01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd984a3-1989-49a7-953f-f4c09de74874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd984a3-1989-49a7-953f-f4c09de74874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '982682eb-263c-4ffa-aac8-d07168f597a7', 'volume_name': 'volume-982682eb-263c-4ffa-aac8-d07168f597a7', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6023599-2096-4ef7-85af-5026aef9de43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6023599-2096-4ef7-85af-5026aef9de43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22654a6-4473-4f4e-94fb-40e38920869e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:12:59 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Volume 982682eb-263c-4ffa-aac8-d07168f597a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-982682eb-263c-4ffa-aac8-d07168f597a7', 'volume_size': 1} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1908121597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=982682eb-263c-4ffa-aac8-d07168f597a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46755c9c22a4b9da3a2c1442c94f517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:12:59Z,use_quota=True,user_id='2e98dcd9d6b64b63a13d1884418a5a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Creating volume 982682eb-263c-4ffa-aac8-d07168f597a7 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:12:59 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-982682eb-263c-4ffa-aac8-d07168f597a7 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:12:59 devstack sudo[97596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-982682eb-263c-4ffa-aac8-d07168f597a7 1073741824 Sep 04 19:12:59 devstack sudo[97596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:12:59 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9fdafe03-6c95-42b6-889d-6328e8ba1657 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:12:59 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-9fdafe03-6c95-42b6-889d-6328e8ba1657 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:12:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9fdafe03-6c95-42b6-889d-6328e8ba1657 tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Retype volume completed successfully. Sep 04 19:12:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8ae0d422-9cf1-48c2-b07e-852833c48e65 tempest-VolumesTransfersV355Test-294491145 None] Transfer volume completed successfully. Sep 04 19:13:00 devstack sudo[97596]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-982682eb-263c-4ffa-aac8-d07168f597a7 1073741824" returned: 0 in 0.559s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-982682eb-263c-4ffa-aac8-d07168f597a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:00 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-982682eb-263c-4ffa-aac8-d07168f597a7 Sep 04 19:13:00 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:00 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-982682eb-263c-4ffa-aac8-d07168f597a7" returned: 0 in 0.337s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22654a6-4473-4f4e-94fb-40e38920869e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-982682eb-263c-4ffa-aac8-d07168f597a7', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a32eff-c5da-43a5-b2d6-096ad0a2a766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Acquiring lock "cinder-36170cc7-fa9e-46b9-a754-08b3092d3bd4-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Acquiring lock "cinder-9231a7ec-bd69-4b3f-9449-6c01c1165841-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:00 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Volume volume-982682eb-263c-4ffa-aac8-d07168f597a7 (982682eb-263c-4ffa-aac8-d07168f597a7): created successfully Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48a32eff-c5da-43a5-b2d6-096ad0a2a766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Flow 'volume_create_manager' (2c79d882-a815-4698-b886-9dbc34fadb48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Lock "cinder-36170cc7-fa9e-46b9-a754-08b3092d3bd4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Lock "cinder-9231a7ec-bd69-4b3f-9449-6c01c1165841-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-03f4e3d7-2086-4852-8e09-6da236ff1c91 tempest-ProjectReaderTests-1495810754 None] Created volume successfully. Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Acquiring lock "cinder-quobyte-36170cc7-fa9e-46b9-a754-08b3092d3bd4" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Acquiring lock "cinder-quobyte-9231a7ec-bd69-4b3f-9449-6c01c1165841" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Lock "cinder-quobyte-36170cc7-fa9e-46b9-a754-08b3092d3bd4" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Lock "cinder-quobyte-9231a7ec-bd69-4b3f-9449-6c01c1165841" acquired by "delete_volume" :: waited 0.038s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[402d27a3-b660-42bd-b352-d0d9e06fea0f]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36170cc7-fa9e-46b9-a754-08b3092d3bd4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec374dd8-ccea-4255-ae99-1687cf554fb7]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9231a7ec-bd69-4b3f-9449-6c01c1165841 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:00 devstack sudo[97606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9231a7ec-bd69-4b3f-9449-6c01c1165841 Sep 04 19:13:00 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36170cc7-fa9e-46b9-a754-08b3092d3bd4 Sep 04 19:13:00 devstack sudo[97606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:01 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:01 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36170cc7-fa9e-46b9-a754-08b3092d3bd4" returned: 0 in 0.458s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:01 devstack sudo[97606]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36170cc7-fa9e-46b9-a754-08b3092d3bd4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9231a7ec-bd69-4b3f-9449-6c01c1165841" returned: 0 in 0.459s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9231a7ec-bd69-4b3f-9449-6c01c1165841 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:01 devstack sudo[97619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36170cc7-fa9e-46b9-a754-08b3092d3bd4 Sep 04 19:13:01 devstack sudo[97619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:01 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9231a7ec-bd69-4b3f-9449-6c01c1165841 Sep 04 19:13:01 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Acquiring lock "cinder-982682eb-263c-4ffa-aac8-d07168f597a7-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Lock "cinder-982682eb-263c-4ffa-aac8-d07168f597a7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:01 devstack sudo[97619]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-36170cc7-fa9e-46b9-a754-08b3092d3bd4" returned: 0 in 0.395s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Lock "cinder-quobyte-36170cc7-fa9e-46b9-a754-08b3092d3bd4" released by "delete_volume" :: held 0.957s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Acquiring lock "cinder-quobyte-982682eb-263c-4ffa-aac8-d07168f597a7" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:01 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9231a7ec-bd69-4b3f-9449-6c01c1165841" returned: 0 in 0.484s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Lock "cinder-quobyte-982682eb-263c-4ffa-aac8-d07168f597a7" acquired by "delete_volume" :: waited 0.061s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Lock "cinder-quobyte-9231a7ec-bd69-4b3f-9449-6c01c1165841" released by "delete_volume" :: held 1.022s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:01 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4abe60d-cd4a-4fae-b5f1-7a095265a93f]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-982682eb-263c-4ffa-aac8-d07168f597a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:01 devstack cinder-volume[87560]: WARNING cinder.quota [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:13:01 devstack cinder-volume[87560]: WARNING cinder.quota [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:13:01 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Created reservations ['1199a96d-57c6-4ddf-a1ab-5eca507e214b', 'a409a285-8a62-43b7-9a4e-f8424ebb0741', '9a47b70e-1433-4684-8903-828b2343ff47', '204fbc38-46be-41ad-a7ec-1a77d80c0b57'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:13:02 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-982682eb-263c-4ffa-aac8-d07168f597a7 Sep 04 19:13:02 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Created reservations ['99daa699-c520-47f3-accc-596daa27b46a', '663fc3d2-0370-477e-a5e7-7d48068c2891', 'acb92362-b8f8-46e8-89fd-999a45f52e9a', '494e3d6a-63f3-4b27-bcd3-aa01f176805c'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:02 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:13:02 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:02 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:13:02 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:02 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-982682eb-263c-4ffa-aac8-d07168f597a7" returned: 0 in 0.488s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-982682eb-263c-4ffa-aac8-d07168f597a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:02 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-982682eb-263c-4ffa-aac8-d07168f597a7 Sep 04 19:13:02 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:02 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.318s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:13:02 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Deleted volume successfully. Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3600c579-48b5-46ca-a93d-a726aee8682c tempest-VolumeRetypeWithoutMigrationTest-1409636504 None] Lock "cinder-36170cc7-fa9e-46b9-a754-08b3092d3bd4-delete_volume" released by "delete_volume" :: held 1.881s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:02 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.289s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:13:02 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Deleted volume successfully. Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5f93dcf1-b5d6-4086-8ef0-eb1019b6af49 tempest-VolumesTransfersV355Test-1357850307 None] Lock "cinder-9231a7ec-bd69-4b3f-9449-6c01c1165841-delete_volume" released by "delete_volume" :: held 1.917s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:02 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-982682eb-263c-4ffa-aac8-d07168f597a7" returned: 0 in 0.291s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Lock "cinder-quobyte-982682eb-263c-4ffa-aac8-d07168f597a7" released by "delete_volume" :: held 0.836s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=192,cinder:UPDATE=238,cinder:DELETE=25,cinder:INSERT=66 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Created reservations ['5c5a17ce-61cb-4026-8b70-73b61435d161', '58da5430-dec2-4b0d-b384-7ad4329369bd', '3cd2887e-2225-4e1e-803c-82a02041bc95', 'adb6b824-fcf0-44d6-a520-0ed135631ee5'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=184,cinder:UPDATE=279,cinder:INSERT=50,cinder:DELETE=15 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:02 devstack sudo[97651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:13:02 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:03 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.340s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:13:03 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Deleted volume successfully. Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e3b343ae-e91a-4ef5-af91-2d21988aeb78 tempest-ProjectReaderTests-1495810754 None] Lock "cinder-982682eb-263c-4ffa-aac8-d07168f597a7-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Flow 'volume_create_manager' (6952a627-003b-42b7-a486-e04b4e3e4a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1080cf9-e822-4751-80eb-fe26cde00e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1080cf9-e822-4751-80eb-fe26cde00e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1309398757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16726b2c-f48a-4d4f-a3e7-449e2cbd8e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f8c84551924bcebb845492ef20149e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:13:04Z,use_quota=True,user_id='3ece8da0945048ff978ddbfe29e2682c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0bc663-fbd2-459a-b0b8-b601dc663daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee0bc663-fbd2-459a-b0b8-b601dc663daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ed21d5-f1aa-4c78-acca-ad00852f0f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ed21d5-f1aa-4c78-acca-ad00852f0f3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16726b2c-f48a-4d4f-a3e7-449e2cbd8e22', 'volume_name': 'volume-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfbaf873-eb6a-431b-a2ee-3442ceb4c73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfbaf873-eb6a-431b-a2ee-3442ceb4c73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67496fd5-89e8-4b0c-8bc5-6e9b09104303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:03 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Volume 16726b2c-f48a-4d4f-a3e7-449e2cbd8e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22', 'volume_size': 1} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:13:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1309398757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16726b2c-f48a-4d4f-a3e7-449e2cbd8e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c8f8c84551924bcebb845492ef20149e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:13:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:13:04Z,use_quota=True,user_id='3ece8da0945048ff978ddbfe29e2682c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Creating volume 16726b2c-f48a-4d4f-a3e7-449e2cbd8e22 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:13:03 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:13:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:03 devstack sudo[97655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22 1073741824 Sep 04 19:13:03 devstack sudo[97655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:04 devstack sudo[97655]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:04 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:13:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Flow 'volume_create_manager' (5ea425f1-d0c8-4aa6-9a82-3065b09ba7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:13:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c1f28f-e943-4f9d-96a3-24f82438e4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22 1073741824" returned: 0 in 1.117s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c1f28f-e943-4f9d-96a3-24f82438e4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1721520090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2162385-a44f-474a-ab95-d4ad47e5b01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46755c9c22a4b9da3a2c1442c94f517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:13:05Z,use_quota=True,user_id='2e98dcd9d6b64b63a13d1884418a5a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a6c547-24af-4435-be95-717368b9f64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a6c547-24af-4435-be95-717368b9f64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd6bc73-a5cf-4f90-8204-2ab2f701fb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fd6bc73-a5cf-4f90-8204-2ab2f701fb13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2162385-a44f-474a-ab95-d4ad47e5b01e', 'volume_name': 'volume-f2162385-a44f-474a-ab95-d4ad47e5b01e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6f7c84-87ec-4c26-9052-ba4a3be169a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6f7c84-87ec-4c26-9052-ba4a3be169a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce70e6e7-0e9c-4f59-bd3f-268d2d38c8ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:05 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Volume f2162385-a44f-474a-ab95-d4ad47e5b01e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2162385-a44f-474a-ab95-d4ad47e5b01e', 'volume_size': 1} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:05 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22 Sep 04 19:13:05 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:05 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22" returned: 0 in 0.343s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.371s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:13:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1721520090',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2162385-a44f-474a-ab95-d4ad47e5b01e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d46755c9c22a4b9da3a2c1442c94f517',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:13:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:13:05Z,use_quota=True,user_id='2e98dcd9d6b64b63a13d1884418a5a13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Creating volume f2162385-a44f-474a-ab95-d4ad47e5b01e {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:13:05 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2162385-a44f-474a-ab95-d4ad47e5b01e 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:05 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2162385-a44f-474a-ab95-d4ad47e5b01e 1073741824 Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67496fd5-89e8-4b0c-8bc5-6e9b09104303) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:05 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35d838f-ecdb-4b23-b135-1eb5e50e7fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:05 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Volume volume-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22 (16726b2c-f48a-4d4f-a3e7-449e2cbd8e22): created successfully Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f35d838f-ecdb-4b23-b135-1eb5e50e7fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Flow 'volume_create_manager' (6952a627-003b-42b7-a486-e04b4e3e4a8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:13:05 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b8237c84-5bab-4ba4-bb3f-04d84741690d tempest-VolumesTransfersV355Test-1747945010 None] Created volume successfully. Sep 04 19:13:06 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2162385-a44f-474a-ab95-d4ad47e5b01e 1073741824" returned: 0 in 0.677s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2162385-a44f-474a-ab95-d4ad47e5b01e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:06 devstack sudo[97738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2162385-a44f-474a-ab95-d4ad47e5b01e Sep 04 19:13:06 devstack sudo[97738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Acquiring lock "cinder-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Lock "cinder-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:06 devstack sudo[97738]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2162385-a44f-474a-ab95-d4ad47e5b01e" returned: 0 in 0.421s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce70e6e7-0e9c-4f59-bd3f-268d2d38c8ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2162385-a44f-474a-ab95-d4ad47e5b01e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ea8384-acdb-45f0-814f-0472cf941da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Acquiring lock "cinder-quobyte-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:06 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Volume volume-f2162385-a44f-474a-ab95-d4ad47e5b01e (f2162385-a44f-474a-ab95-d4ad47e5b01e): created successfully Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ea8384-acdb-45f0-814f-0472cf941da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Flow 'volume_create_manager' (5ea425f1-d0c8-4aa6-9a82-3065b09ba7a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Lock "cinder-quobyte-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22" acquired by "delete_volume" :: waited 0.052s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fbfc7af3-1a57-48a3-aab0-1ba4223b5a48 tempest-ProjectReaderTests-1495810754 None] Created volume successfully. Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07ccbda-2066-41f8-a4ba-59b8d2adf170]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:06 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22 Sep 04 19:13:06 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ce1d45a0-093b-4887-8d2c-b98539bb733f tempest-VolumesActionsTest-1082017113 None] Acquiring lock "cinder-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" by "attach_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ce1d45a0-093b-4887-8d2c-b98539bb733f tempest-VolumesActionsTest-1082017113 None] Lock "cinder-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" acquired by "attach_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ce1d45a0-093b-4887-8d2c-b98539bb733f tempest-VolumesActionsTest-1082017113 None] Attaching volume a72549aa-b7b2-4bd0-abf8-7f04aea4014a to instance ea44e017-b3c7-4415-a57a-5d545d396a3e at mountpoint /dev/vdb on host None. Sep 04 19:13:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ce1d45a0-093b-4887-8d2c-b98539bb733f tempest-VolumesActionsTest-1082017113 None] Attach volume completed successfully. Sep 04 19:13:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ce1d45a0-093b-4887-8d2c-b98539bb733f tempest-VolumesActionsTest-1082017113 None] Lock "cinder-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" released by "attach_volume" :: held 0.145s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Acquiring lock "cinder-f2162385-a44f-474a-ab95-d4ad47e5b01e-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Lock "cinder-f2162385-a44f-474a-ab95-d4ad47e5b01e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:07 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22" returned: 0 in 0.588s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:07 devstack sudo[97746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22 Sep 04 19:13:07 devstack sudo[97746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Acquiring lock "cinder-quobyte-f2162385-a44f-474a-ab95-d4ad47e5b01e" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-925c50dd-61d1-4719-b4ca-fa8521595e8d tempest-VolumesActionsTest-1082017113 None] Acquiring lock "cinder-a72549aa-b7b2-4bd0-abf8-7f04aea4014a-detach_volume" by "detach_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Lock "cinder-quobyte-f2162385-a44f-474a-ab95-d4ad47e5b01e" acquired by "delete_volume" :: waited 0.055s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-925c50dd-61d1-4719-b4ca-fa8521595e8d tempest-VolumesActionsTest-1082017113 None] Lock "cinder-a72549aa-b7b2-4bd0-abf8-7f04aea4014a-detach_volume" acquired by "detach_volume" :: waited 0.062s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-925c50dd-61d1-4719-b4ca-fa8521595e8d tempest-VolumesActionsTest-1082017113 None] Detaching volume a72549aa-b7b2-4bd0-abf8-7f04aea4014a from instance ea44e017-b3c7-4415-a57a-5d545d396a3e. Sep 04 19:13:07 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[517be8a6-3cd9-4b8a-8a7f-48587cd212a8]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2162385-a44f-474a-ab95-d4ad47e5b01e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-925c50dd-61d1-4719-b4ca-fa8521595e8d tempest-VolumesActionsTest-1082017113 None] Detach volume completed successfully. Sep 04 19:13:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-925c50dd-61d1-4719-b4ca-fa8521595e8d tempest-VolumesActionsTest-1082017113 None] Lock "cinder-a72549aa-b7b2-4bd0-abf8-7f04aea4014a-detach_volume" released by "detach_volume" :: held 0.116s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:07 devstack sudo[97748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2162385-a44f-474a-ab95-d4ad47e5b01e Sep 04 19:13:07 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:07 devstack sudo[97746]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22" returned: 0 in 0.587s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Lock "cinder-quobyte-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22" released by "delete_volume" :: held 1.251s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:08 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Created reservations ['d1c9bbb2-76b8-4819-95f3-ac377f0a9d88', '74903b99-0b5a-45fa-8fcb-cbcda0aa1747', 'baaf4518-a447-43d5-8ae5-46cb935081fd', '2a3c3373-7795-4343-9fcb-fd53de1112cf'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:13:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:13:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:13:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:08 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:08 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:13:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2162385-a44f-474a-ab95-d4ad47e5b01e" returned: 0 in 0.807s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:08 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2162385-a44f-474a-ab95-d4ad47e5b01e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:08 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2162385-a44f-474a-ab95-d4ad47e5b01e Sep 04 19:13:08 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:08 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.448s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:08 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:13:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Deleted volume successfully. Sep 04 19:13:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61368b0b-c044-4ef4-ba10-e981a2c94441 tempest-VolumesTransfersV355Test-1357850307 None] Lock "cinder-16726b2c-f48a-4d4f-a3e7-449e2cbd8e22-delete_volume" released by "delete_volume" :: held 2.324s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:08 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2162385-a44f-474a-ab95-d4ad47e5b01e" returned: 0 in 0.565s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Lock "cinder-quobyte-f2162385-a44f-474a-ab95-d4ad47e5b01e" released by "delete_volume" :: held 1.460s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:09 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Created reservations ['1e5500a7-d54c-4490-9c9a-6da997b88780', 'a7c9a8e0-5db5-43ab-96f6-749f3862a75b', '0d686ed1-7a13-458e-a665-1117402fc6a9', 'caeab621-6d1d-410a-a529-331fb117e0a0'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:13:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:13:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:13:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:09 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:13:09 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:09 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.609s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:13:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Deleted volume successfully. Sep 04 19:13:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b74e69d3-2349-452a-a9f2-17215376012a tempest-ProjectReaderTests-1495810754 None] Lock "cinder-f2162385-a44f-474a-ab95-d4ad47e5b01e-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1b37bf68-3dfd-49ee-bf76-4711f00e2ad3 tempest-VolumesActionsTest-1082017113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1b37bf68-3dfd-49ee-bf76-4711f00e2ad3 tempest-VolumesActionsTest-1082017113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2c90d6-4c43-41c3-88c0-8bdadc061175]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b37bf68-3dfd-49ee-bf76-4711f00e2ad3 tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:13 devstack sudo[97790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a Sep 04 19:13:13 devstack sudo[97790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:13 devstack sudo[97790]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b37bf68-3dfd-49ee-bf76-4711f00e2ad3 tempest-VolumesActionsTest-1082017113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" returned: 0 in 0.392s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f0ef11-2211-4c3d-9ebd-4b0ed82af8f0]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b37bf68-3dfd-49ee-bf76-4711f00e2ad3 tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:13 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a Sep 04 19:13:13 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:14 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b37bf68-3dfd-49ee-bf76-4711f00e2ad3 tempest-VolumesActionsTest-1082017113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" returned: 0 in 0.459s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b37bf68-3dfd-49ee-bf76-4711f00e2ad3 tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.7780ab20-a9a4-4ce7-b415-78f5fe08d45aqhc8cegi.img {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:14 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.7780ab20-a9a4-4ce7-b415-78f5fe08d45aqhc8cegi.img Sep 04 19:13:14 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:18 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:13:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Flow 'volume_create_manager' (8ff0f3d4-f715-40cc-a1da-8c5854b9c153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:13:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfd6575-7f5f-4cbe-9f85-30dd1b73b8f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1dfd6575-7f5f-4cbe-9f85-30dd1b73b8f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-581655073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cfc391-a30d-4329-a922-c123a3e9f655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7087a4e5885742c6b45bf2ae102dfd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:13:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:13:18Z,use_quota=True,user_id='9e604bb6529e48519507e9899c96f179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a675974-cbcd-46dd-8a6e-702e0450a0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a675974-cbcd-46dd-8a6e-702e0450a0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ebcaea-7df1-4948-a885-9b84902ffee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2ebcaea-7df1-4948-a885-9b84902ffee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66cfc391-a30d-4329-a922-c123a3e9f655', 'volume_name': 'volume-66cfc391-a30d-4329-a922-c123a3e9f655', 'volume_size': 2}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba52c05-8fd0-46fd-b9aa-6125ca166b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bba52c05-8fd0-46fd-b9aa-6125ca166b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d88218d-09b1-4d14-be68-034b13eb14e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:18 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Volume 66cfc391-a30d-4329-a922-c123a3e9f655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66cfc391-a30d-4329-a922-c123a3e9f655', 'volume_size': 2} Sep 04 19:13:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:19 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b37bf68-3dfd-49ee-bf76-4711f00e2ad3 tempest-VolumesActionsTest-1082017113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.7780ab20-a9a4-4ce7-b415-78f5fe08d45aqhc8cegi.img" returned: 0 in 5.302s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:19 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3573048-7bf4-470f-aeeb-f75acc4ee067]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b37bf68-3dfd-49ee-bf76-4711f00e2ad3 tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:19 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a Sep 04 19:13:19 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:20 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b37bf68-3dfd-49ee-bf76-4711f00e2ad3 tempest-VolumesActionsTest-1082017113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" returned: 0 in 0.538s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:20 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-1b37bf68-3dfd-49ee-bf76-4711f00e2ad3 tempest-VolumesActionsTest-1082017113 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.7780ab20-a9a4-4ce7-b415-78f5fe08d45aqhc8cegi.img {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:13:20 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-1b37bf68-3dfd-49ee-bf76-4711f00e2ad3 tempest-VolumesActionsTest-1082017113 None] Converted 1024.00 MB image at 193.10 MB/s Sep 04 19:13:20 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-1b37bf68-3dfd-49ee-bf76-4711f00e2ad3 tempest-VolumesActionsTest-1082017113 None] 7780ab20-a9a4-4ce7-b415-78f5fe08d45a was raw, no need to convert to raw {{(pid=87560) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 04 19:13:21 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:13:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Flow 'volume_create_manager' (29ed79c3-6591-45e8-a3f9-eb1180c83827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:13:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40f0956-5944-429e-9e15-802eef91ae8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c40f0956-5944-429e-9e15-802eef91ae8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1634976749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=391dc06e-c38d-45a2-9380-b836181b762d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18520285792040a08cd6141345465045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:13:22Z,use_quota=True,user_id='11a83d2b655740be9166a0bf2bfcde76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f866125-261a-4548-9b46-e2b6d62b5456),volume_type_id=7f866125-261a-4548-9b46-e2b6d62b5456)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82072a9f-a96f-437d-9234-84e5d7edfb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82072a9f-a96f-437d-9234-84e5d7edfb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042510f6-7bc1-4140-bf74-44a78f6cc09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (042510f6-7bc1-4140-bf74-44a78f6cc09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '391dc06e-c38d-45a2-9380-b836181b762d', 'volume_name': 'volume-391dc06e-c38d-45a2-9380-b836181b762d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319c48a7-6e9d-4acd-9850-feda1f194481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (319c48a7-6e9d-4acd-9850-feda1f194481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d381056-55f7-41f8-82f2-d339c4af2261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:21 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Volume 391dc06e-c38d-45a2-9380-b836181b762d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-391dc06e-c38d-45a2-9380-b836181b762d', 'volume_size': 1} Sep 04 19:13:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:31 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=33,cinder:SELECT=29,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:13:31 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:DELETE=2,cinder:UPDATE=28,cinder:SELECT=22,cinder:INSERT=5 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:13:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1b37bf68-3dfd-49ee-bf76-4711f00e2ad3 tempest-VolumesActionsTest-1082017113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.530s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1b37bf68-3dfd-49ee-bf76-4711f00e2ad3 tempest-VolumesActionsTest-1082017113 None] Uploaded volume to glance image-id: 7780ab20-a9a4-4ce7-b415-78f5fe08d45a. {{(pid=87560) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 19:13:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.147s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-581655073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66cfc391-a30d-4329-a922-c123a3e9f655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7087a4e5885742c6b45bf2ae102dfd62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:13:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:13:18Z,use_quota=True,user_id='9e604bb6529e48519507e9899c96f179',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:13:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Creating volume 66cfc391-a30d-4329-a922-c123a3e9f655 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:13:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:13:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:13:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:13:38 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:13:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655 2147483648 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:38 devstack sudo[97861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655 2147483648 Sep 04 19:13:38 devstack sudo[97861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1b37bf68-3dfd-49ee-bf76-4711f00e2ad3 tempest-VolumesActionsTest-1082017113 None] Copy volume to image completed successfully. Sep 04 19:13:39 devstack sudo[97861]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655 2147483648" returned: 0 in 0.431s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:39 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655 Sep 04 19:13:39 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:39 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655" returned: 0 in 0.271s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.659s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1634976749',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=391dc06e-c38d-45a2-9380-b836181b762d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18520285792040a08cd6141345465045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:13:22Z,use_quota=True,user_id='11a83d2b655740be9166a0bf2bfcde76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f866125-261a-4548-9b46-e2b6d62b5456),volume_type_id=7f866125-261a-4548-9b46-e2b6d62b5456)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Creating volume 391dc06e-c38d-45a2-9380-b836181b762d {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:13:39 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-391dc06e-c38d-45a2-9380-b836181b762d 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:39 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-391dc06e-c38d-45a2-9380-b836181b762d 1073741824 Sep 04 19:13:39 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d88218d-09b1-4d14-be68-034b13eb14e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66cfc391-a30d-4329-a922-c123a3e9f655', 'volume_size': 2}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0eaa146-79dc-483a-8f59-f975caa314db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:39 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Volume volume-66cfc391-a30d-4329-a922-c123a3e9f655 (66cfc391-a30d-4329-a922-c123a3e9f655): created successfully Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0eaa146-79dc-483a-8f59-f975caa314db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Flow 'volume_create_manager' (8ff0f3d4-f715-40cc-a1da-8c5854b9c153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:13:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2697f24c-139f-4b9c-bd75-7f743454117e tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Created volume successfully. Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:40 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-391dc06e-c38d-45a2-9380-b836181b762d 1073741824" returned: 0 in 0.532s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-391dc06e-c38d-45a2-9380-b836181b762d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:40 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-391dc06e-c38d-45a2-9380-b836181b762d Sep 04 19:13:40 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:40 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-391dc06e-c38d-45a2-9380-b836181b762d" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.364s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d381056-55f7-41f8-82f2-d339c4af2261) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-391dc06e-c38d-45a2-9380-b836181b762d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fc0cf4-c2eb-4960-b802-478df84784a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Creating offline snapshot 304ce922-dd8c-44fe-9bf7-063fa0756b38 of volume 66cfc391-a30d-4329-a922-c123a3e9f655 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:13:40 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Volume volume-391dc06e-c38d-45a2-9380-b836181b762d (391dc06e-c38d-45a2-9380-b836181b762d): created successfully Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fc0cf4-c2eb-4960-b802-478df84784a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Flow 'volume_create_manager' (29ed79c3-6591-45e8-a3f9-eb1180c83827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2736ec-f65d-4ba6-b95f-94c5f4777c18]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:40 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-74280551-0257-4f0b-b7aa-9925eae96f97 tempest-VolumeTypesAccessTest-1696133553 None] Created volume successfully. Sep 04 19:13:40 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655 Sep 04 19:13:40 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:40 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655" returned: 0 in 0.342s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38 2G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:40 devstack sudo[97886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38 2G Sep 04 19:13:40 devstack sudo[97886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Acquiring lock "cinder-391dc06e-c38d-45a2-9380-b836181b762d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Lock "cinder-391dc06e-c38d-45a2-9380-b836181b762d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Acquiring lock "cinder-quobyte-391dc06e-c38d-45a2-9380-b836181b762d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Lock "cinder-quobyte-391dc06e-c38d-45a2-9380-b836181b762d" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60ca168-d715-4d48-8665-cff60ef73c3c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-391dc06e-c38d-45a2-9380-b836181b762d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:41 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-391dc06e-c38d-45a2-9380-b836181b762d Sep 04 19:13:41 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:41 devstack sudo[97886]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38 2G" returned: 0 in 0.410s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66cfc391-a30d-4329-a922-c123a3e9f655 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:41 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66cfc391-a30d-4329-a922-c123a3e9f655 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38 Sep 04 19:13:41 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:41 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-391dc06e-c38d-45a2-9380-b836181b762d" returned: 0 in 0.361s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-391dc06e-c38d-45a2-9380-b836181b762d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:41 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-391dc06e-c38d-45a2-9380-b836181b762d Sep 04 19:13:41 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:41 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66cfc391-a30d-4329-a922-c123a3e9f655 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38" returned: 0 in 0.291s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:41 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38 is being set with open permissions: ugo+rw Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:41 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38 Sep 04 19:13:41 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:41 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-391dc06e-c38d-45a2-9380-b836181b762d" returned: 0 in 0.245s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Lock "cinder-quobyte-391dc06e-c38d-45a2-9380-b836181b762d" released by "delete_volume" :: held 0.652s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:41 devstack cinder-volume[87560]: WARNING cinder.quota [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1357011849 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1357011849, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:13:41 devstack cinder-volume[87560]: WARNING cinder.quota [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1357011849 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1357011849, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:13:41 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38" returned: 0 in 0.242s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Created reservations ['e8e322df-a7ed-4f07-b55e-5622b4f8953d', 'bafe09f5-fb4b-40ba-a0c3-8e36f2ead552', '040eb52e-dbd4-4b6a-924d-ec755bbbccdf', '6d23dc9f-66f1-4e8b-9756-0d0cb6f249de'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:41 devstack sudo[97909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.info Sep 04 19:13:41 devstack sudo[97909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:41 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:13:41 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:42 devstack sudo[97909]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.info" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:42 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.info is being set with open permissions: ugo+rw Sep 04 19:13:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:42 devstack sudo[97915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.info Sep 04 19:13:42 devstack sudo[97915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:42 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.261s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:42 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:13:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Deleted volume successfully. Sep 04 19:13:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e6bf20f0-4d2c-4f75-8499-2d13d293c863 tempest-VolumeTypesAccessTest-1696133553 None] Lock "cinder-391dc06e-c38d-45a2-9380-b836181b762d-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:42 devstack sudo[97915]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.info" returned: 0 in 0.266s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.984s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:42 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85b8610-57ef-4993-85d1-13b333c3672b]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7340620c-8ce3-4679-ba1b-0252f39b1b06 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Create snapshot completed successfully Sep 04 19:13:42 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a Sep 04 19:13:42 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:42 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" returned: 0 in 0.367s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:42 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[729f65ce-0b80-472c-9a4a-cf80f79a0111]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:42 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a Sep 04 19:13:42 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:43 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" returned: 0 in 0.371s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.4152b3a2-d562-49be-bc9d-57727829e0e4o5gqhxwv.img {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:43 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.4152b3a2-d562-49be-bc9d-57727829e0e4o5gqhxwv.img Sep 04 19:13:43 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Acquiring lock "cinder-304ce922-dd8c-44fe-9bf7-063fa0756b38-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "cinder-304ce922-dd8c-44fe-9bf7-063fa0756b38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Acquiring lock "cinder-quobyte-66cfc391-a30d-4329-a922-c123a3e9f655" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "cinder-quobyte-66cfc391-a30d-4329-a922-c123a3e9f655" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Acquiring lock "cinder-quobyte-304ce922-dd8c-44fe-9bf7-063fa0756b38" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "cinder-quobyte-304ce922-dd8c-44fe-9bf7-063fa0756b38" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Deleting offline snapshot 304ce922-dd8c-44fe-9bf7-063fa0756b38 of volume 66cfc391-a30d-4329-a922-c123a3e9f655 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:13:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] snapshot_file for this snap is: volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:13:43 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c90ed6-e81d-40f4-9efe-51af50bf9ed7]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:43 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38 Sep 04 19:13:43 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:44 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38" returned: 0 in 0.900s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66cfc391-a30d-4329-a922-c123a3e9f655(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:13:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11d3e40-cc18-4952-92be-d828a1e3f0c6]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:44 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655 Sep 04 19:13:44 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:13:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:13:45 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:13:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655" returned: 0 in 0.792s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:45 devstack sudo[97951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:13:45 devstack sudo[97951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:45 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38 Sep 04 19:13:45 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:45 devstack sudo[97951]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.645s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:13:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:13:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:13:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:13:46 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38" returned: 0 in 0.771s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:46 devstack sudo[97959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38 Sep 04 19:13:46 devstack sudo[97959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:46 devstack sudo[97959]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655.304ce922-dd8c-44fe-9bf7-063fa0756b38" returned: 0 in 0.563s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "cinder-quobyte-304ce922-dd8c-44fe-9bf7-063fa0756b38" released by "_delete_snapshot" :: held 3.265s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "cinder-quobyte-66cfc391-a30d-4329-a922-c123a3e9f655" released by "delete_snapshot" :: held 3.302s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:46 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Created reservations ['1c6d3a7c-3f49-48b8-9c8a-310e4bb13b9f', '86566d8f-b89f-408f-8a83-4d5f7b8ae0e1', '519c6b9a-3edd-49f7-9ed0-635176e01c41', '4038b823-8028-43b2-b375-36ed3af56f4e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:13:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Delete snapshot completed successfully. Sep 04 19:13:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a09046c4-524f-4b16-9923-7d57b0864264 tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "cinder-304ce922-dd8c-44fe-9bf7-063fa0756b38-delete_snapshot" released by "delete_snapshot" :: held 3.717s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Acquiring lock "cinder-66cfc391-a30d-4329-a922-c123a3e9f655-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "cinder-66cfc391-a30d-4329-a922-c123a3e9f655-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Acquiring lock "cinder-quobyte-66cfc391-a30d-4329-a922-c123a3e9f655" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "cinder-quobyte-66cfc391-a30d-4329-a922-c123a3e9f655" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:48 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.4152b3a2-d562-49be-bc9d-57727829e0e4o5gqhxwv.img" returned: 0 in 5.148s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a4bad8-ec37-41a8-ba40-6c97b3853ecb]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[68722aa1-f30d-4253-a1d7-71443d06be20]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:48 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655 Sep 04 19:13:48 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:48 devstack sudo[97966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a Sep 04 19:13:48 devstack sudo[97966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:48 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655" returned: 0 in 0.408s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:48 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655 Sep 04 19:13:48 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:48 devstack sudo[97966]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" returned: 0 in 0.568s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:48 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a, size 1024.00 MB, duration 5.15 sec, destination /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.4152b3a2-d562-49be-bc9d-57727829e0e4o5gqhxwv.img {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:13:48 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Converted 1024.00 MB image at 198.86 MB/s Sep 04 19:13:48 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] 4152b3a2-d562-49be-bc9d-57727829e0e4 was raw, converting to qcow2 {{(pid=87560) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 04 19:13:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1da003-8037-4af3-a42e-e673cec23d16]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.4152b3a2-d562-49be-bc9d-57727829e0e4o5gqhxwv.img {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:49 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-66cfc391-a30d-4329-a922-c123a3e9f655" returned: 0 in 0.270s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "cinder-quobyte-66cfc391-a30d-4329-a922-c123a3e9f655" released by "delete_volume" :: held 0.762s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:49 devstack sudo[97977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.4152b3a2-d562-49be-bc9d-57727829e0e4o5gqhxwv.img Sep 04 19:13:49 devstack sudo[97977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Created reservations ['7f2e8bdf-c712-4004-a065-9866d37a44c5', 'f08af69e-1596-460b-a863-e58f85fba5f0', 'dd9b131a-da34-4a9b-a303-62a65cd716a8', '2d1f0eb8-ebff-4b35-b391-f1021d34a617'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:49 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:13:49 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:49 devstack sudo[97977]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.4152b3a2-d562-49be-bc9d-57727829e0e4o5gqhxwv.img" returned: 0 in 0.429s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.4152b3a2-d562-49be-bc9d-57727829e0e4o5gqhxwv.img {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:49 devstack sudo[97990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.4152b3a2-d562-49be-bc9d-57727829e0e4o5gqhxwv.img Sep 04 19:13:49 devstack sudo[97990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:49 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.340s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:13:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Deleted volume successfully. Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-61f4871f-48fc-4da6-9fc8-b2656b40775a tempest-VolumesSnapshotNegativeTestJSON-1530698891 None] Lock "cinder-66cfc391-a30d-4329-a922-c123a3e9f655-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:49 devstack sudo[97990]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.4152b3a2-d562-49be-bc9d-57727829e0e4o5gqhxwv.img" returned: 1 in 0.382s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.4152b3a2-d562-49be-bc9d-57727829e0e4o5gqhxwv.img' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:13:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.4152b3a2-d562-49be-bc9d-57727829e0e4o5gqhxwv.img /opt/stack/data/cinder/conversion/vol_upload_v41v97me {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:49 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.4152b3a2-d562-49be-bc9d-57727829e0e4o5gqhxwv.img /opt/stack/data/cinder/conversion/vol_upload_v41v97me Sep 04 19:13:49 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:50 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.4152b3a2-d562-49be-bc9d-57727829e0e4o5gqhxwv.img /opt/stack/data/cinder/conversion/vol_upload_v41v97me" returned: 0 in 0.299s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:50 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Image conversion details: src /opt/stack/data/cinder/conversion/a72549aa-b7b2-4bd0-abf8-7f04aea4014a.temp_image.4152b3a2-d562-49be-bc9d-57727829e0e4o5gqhxwv.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_v41v97me {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:13:50 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 04 19:13:50 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55ee99f-e23c-49cf-bbc2-05f8c8b9f22a]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_v41v97me {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:50 devstack sudo[98002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_v41v97me Sep 04 19:13:50 devstack sudo[98002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:50 devstack sudo[98002]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_v41v97me" returned: 0 in 0.389s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.838s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Uploaded volume to glance image-id: 4152b3a2-d562-49be-bc9d-57727829e0e4. {{(pid=87560) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 04 19:13:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2cd98607-da4e-4c12-88ce-77b291067ce5 tempest-VolumesActionsTest-1082017113 None] Copy volume to image completed successfully. Sep 04 19:13:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Acquiring lock "cinder-a72549aa-b7b2-4bd0-abf8-7f04aea4014a-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Lock "cinder-a72549aa-b7b2-4bd0-abf8-7f04aea4014a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Acquiring lock "cinder-quobyte-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:13:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Lock "cinder-quobyte-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:13:54 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2900f834-453e-4272-87de-a357713041a8]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:13:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:54 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a Sep 04 19:13:54 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:54 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" returned: 0 in 0.429s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:54 devstack sudo[98014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a Sep 04 19:13:54 devstack sudo[98014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:54 devstack sudo[98014]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Lock "cinder-quobyte-a72549aa-b7b2-4bd0-abf8-7f04aea4014a" released by "delete_volume" :: held 0.739s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:13:54 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Created reservations ['7e974d22-b097-462f-b045-c0a4f12e54c9', '282d2cfb-d42d-4d9c-93d2-1693042433c2', '715b21ae-5fe7-4334-83ee-b7c417dd81c3', '3d50d499-992b-4e81-bcc1-09e4001c7653'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:13:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:13:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:13:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:13:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:13:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:13:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:13:54 devstack sudo[98017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:13:54 devstack sudo[98017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:13:55 devstack sudo[98017]: pam_unix(sudo:session): session closed for user root Sep 04 19:13:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.326s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:13:55 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:13:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Deleted volume successfully. Sep 04 19:13:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-91647381-030c-462f-9924-5110ba3867ef tempest-VolumesActionsTest-1082017113 None] Lock "cinder-a72549aa-b7b2-4bd0-abf8-7f04aea4014a-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:04 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=36,cinder:SELECT=24,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:14:05 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=33,cinder:INSERT=11,cinder:UPDATE=38,cinder:DELETE=3 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:14:09 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:14:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Flow 'volume_create_manager' (499eab08-143f-4f3b-913c-4c6dc4015622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32319d3f-0d20-42bb-8265-719833be2061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32319d3f-0d20-42bb-8265-719833be2061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-764403418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b575aa-2b12-42fb-be8d-24e690549beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc84edc166d548c09854d63f40fc05a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:09Z,use_quota=True,user_id='9a29a5c076504e1186e1800d7f29e36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0459307-d37d-4746-b147-8f3531e80bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0459307-d37d-4746-b147-8f3531e80bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359b102d-5b37-4be3-bb16-533d6f677806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:09 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 19:14:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (359b102d-5b37-4be3-bb16-533d6f677806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '48b575aa-2b12-42fb-be8d-24e690549beb', 'volume_name': 'volume-48b575aa-2b12-42fb-be8d-24e690549beb', 'volume_size': 1, 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd0ece6d722f24154ab955bf866d06cbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'created_at': datetime.datetime(2026, 9, 4, 16, 58, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 58, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e637b08c-391d-4edc-8402-9ba212deb71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ab606c-59a9-41c4-adcd-9ad79acec8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ab606c-59a9-41c4-adcd-9ad79acec8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a574bbd3-2407-4b18-b5a6-ff8a20e2cada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:09 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Volume 48b575aa-2b12-42fb-be8d-24e690549beb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-48b575aa-2b12-42fb-be8d-24e690549beb', 'volume_size': 1, 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd0ece6d722f24154ab955bf866d06cbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'created_at': datetime.datetime(2026, 9, 4, 16, 58, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 58, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e637b08c-391d-4edc-8402-9ba212deb71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 19:14:09 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Trying to clone 48b575aa-2b12-42fb-be8d-24e690549beb from image e637b08c-391d-4edc-8402-9ba212deb71d at location (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 19:14:10 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_674mshvedevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 19:14:10 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Image download 20.69 MB at 20.69 MB/s Sep 04 19:14:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d733ec-4cce-4292-8772-f51828d97e7e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_674mshvedevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:10 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_674mshvedevstack@QuobyteHD Sep 04 19:14:10 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:10 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_674mshvedevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:10 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Temporary image e637b08c-391d-4edc-8402-9ba212deb71d is fetched for user 9a29a5c076504e1186e1800d7f29e36d. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 19:14:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b8636b-3434-481b-8b56-e71b5b28b5c8]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_674mshvedevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:10 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_674mshvedevstack@QuobyteHD Sep 04 19:14:10 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:11 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_674mshvedevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-764403418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b575aa-2b12-42fb-be8d-24e690549beb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc84edc166d548c09854d63f40fc05a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:09Z,use_quota=True,user_id='9a29a5c076504e1186e1800d7f29e36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:14:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Creating volume 48b575aa-2b12-42fb-be8d-24e690549beb {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:14:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:14:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:14:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:14:11 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:14:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:11 devstack sudo[98037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb 1073741824 Sep 04 19:14:11 devstack sudo[98037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:11 devstack sudo[98037]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb 1073741824" returned: 0 in 0.522s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:11 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb Sep 04 19:14:11 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:12 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb" returned: 0 in 0.318s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:14:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:12 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Attempting download of e637b08c-391d-4edc-8402-9ba212deb71d ((None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}])) to volume 48b575aa-2b12-42fb-be8d-24e690549beb. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 19:14:12 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0fb253-f8c1-44a7-9416-d1f949d0199e]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_6d9042hk {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:12 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_6d9042hk Sep 04 19:14:12 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:12 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_6d9042hk" returned: 0 in 0.472s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_6d9042hk {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:12 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_6d9042hk Sep 04 19:14:12 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:13 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_6d9042hk" returned: 1 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_6d9042hk' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:14:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d9c571-2090-43b4-9814-d24d84cc8f4a]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_674mshvedevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:13 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_674mshvedevstack@QuobyteHD Sep 04 19:14:13 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:13 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_674mshvedevstack@QuobyteHD" returned: 0 in 0.423s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:13 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] e637b08c-391d-4edc-8402-9ba212deb71d was qcow2, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 19:14:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_674mshvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:13 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_674mshvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb Sep 04 19:14:13 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:15 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_674mshvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb" returned: 0 in 2.118s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:15 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_674mshvedevstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:14:15 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Converted 112.00 MB image at 52.86 MB/s Sep 04 19:14:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:15 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb 1G Sep 04 19:14:15 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:15 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb 1G" returned: 0 in 0.346s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:15 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Downloaded image e637b08c-391d-4edc-8402-9ba212deb71d ((None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}])) to volume 48b575aa-2b12-42fb-be8d-24e690549beb successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 19:14:15 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Temporary image e637b08c-391d-4edc-8402-9ba212deb71d for user 9a29a5c076504e1186e1800d7f29e36d is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 19:14:15 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Marking volume 48b575aa-2b12-42fb-be8d-24e690549beb as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 19:14:15 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Copying metadata from image e637b08c-391d-4edc-8402-9ba212deb71d to 48b575aa-2b12-42fb-be8d-24e690549beb. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 19:14:15 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Creating volume glance metadata for volume 48b575aa-2b12-42fb-be8d-24e690549beb backed by image e637b08c-391d-4edc-8402-9ba212deb71d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 19:14:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a574bbd3-2407-4b18-b5a6-ff8a20e2cada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b575aa-2b12-42fb-be8d-24e690549beb', 'volume_size': 1, 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd0ece6d722f24154ab955bf866d06cbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'created_at': datetime.datetime(2026, 9, 4, 16, 58, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 58, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e637b08c-391d-4edc-8402-9ba212deb71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fef881-39d6-4d5d-b8df-4958aea52368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:16 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Volume volume-48b575aa-2b12-42fb-be8d-24e690549beb (48b575aa-2b12-42fb-be8d-24e690549beb): created successfully Sep 04 19:14:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fef881-39d6-4d5d-b8df-4958aea52368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Flow 'volume_create_manager' (499eab08-143f-4f3b-913c-4c6dc4015622) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2ab78d37-619f-4b61-8eb0-75051804b777 tempest-VolumesExtendTest-1028169703 None] Created volume successfully. Sep 04 19:14:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f423edcb-6cfc-467e-b599-a2e25a436113 tempest-VolumesExtendTest-1028169703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f423edcb-6cfc-467e-b599-a2e25a436113 tempest-VolumesExtendTest-1028169703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:17 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e31aa4-0ae4-4770-bb52-df2a7c18ed70]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f423edcb-6cfc-467e-b599-a2e25a436113 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:17 devstack sudo[98076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb Sep 04 19:14:17 devstack sudo[98076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:17 devstack sudo[98076]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f423edcb-6cfc-467e-b599-a2e25a436113 tempest-VolumesExtendTest-1028169703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb" returned: 0 in 0.438s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f423edcb-6cfc-467e-b599-a2e25a436113 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb 2G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f423edcb-6cfc-467e-b599-a2e25a436113 tempest-VolumesExtendTest-1028169703 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb 2G" returned: 0 in 0.113s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f423edcb-6cfc-467e-b599-a2e25a436113 tempest-VolumesExtendTest-1028169703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.572s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f423edcb-6cfc-467e-b599-a2e25a436113 tempest-VolumesExtendTest-1028169703 None] Extend volume completed successfully. Sep 04 19:14:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Acquiring lock "cinder-48b575aa-2b12-42fb-be8d-24e690549beb-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Lock "cinder-48b575aa-2b12-42fb-be8d-24e690549beb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Acquiring lock "cinder-quobyte-48b575aa-2b12-42fb-be8d-24e690549beb" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Lock "cinder-quobyte-48b575aa-2b12-42fb-be8d-24e690549beb" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:18 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbf1401-db56-487c-91d8-5401956adf34]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:18 devstack sudo[98085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb Sep 04 19:14:18 devstack sudo[98085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:19 devstack sudo[98085]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb" returned: 0 in 0.406s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:19 devstack sudo[98090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb Sep 04 19:14:19 devstack sudo[98090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:19 devstack sudo[98090]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48b575aa-2b12-42fb-be8d-24e690549beb" returned: 0 in 0.315s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Lock "cinder-quobyte-48b575aa-2b12-42fb-be8d-24e690549beb" released by "delete_volume" :: held 0.850s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:19 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Created reservations ['7308ea72-f9b3-47d8-b7b9-c6c7b594d01e', '85ff5775-a5f4-41d7-b768-b84a2f8df900', 'fbf3d0e9-7fce-418a-ade5-cb1564875a8e', '6d339e72-0e14-424e-bcb8-113be43af8f7'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:14:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:14:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:14:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:19 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:14:19 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:19 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.314s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:19 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:14:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Deleted volume successfully. Sep 04 19:14:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-677687df-817e-41e7-a6a7-d5458ab0ba50 tempest-VolumesExtendTest-1028169703 None] Lock "cinder-48b575aa-2b12-42fb-be8d-24e690549beb-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Flow 'volume_create_manager' (f18317e7-6804-4704-a901-8e3fe4e86e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff8f0c58-4562-4318-bd4b-d8fbe6c07d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff8f0c58-4562-4318-bd4b-d8fbe6c07d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1270603915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8454daa4-bcc3-4fd6-b680-d3b348f86697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc84edc166d548c09854d63f40fc05a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:20Z,use_quota=True,user_id='9a29a5c076504e1186e1800d7f29e36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56495bc-2064-4a6a-8490-aa8050a016df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e56495bc-2064-4a6a-8490-aa8050a016df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8900600c-ab47-46b5-b308-6532507f6cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8900600c-ab47-46b5-b308-6532507f6cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8454daa4-bcc3-4fd6-b680-d3b348f86697', 'volume_name': 'volume-8454daa4-bcc3-4fd6-b680-d3b348f86697', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba06b6a-55ed-406c-b0f4-df1eb95f072c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba06b6a-55ed-406c-b0f4-df1eb95f072c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667c77d3-f057-4143-803f-95e67a466028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:20 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Volume 8454daa4-bcc3-4fd6-b680-d3b348f86697: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8454daa4-bcc3-4fd6-b680-d3b348f86697', 'volume_size': 1} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1270603915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8454daa4-bcc3-4fd6-b680-d3b348f86697,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc84edc166d548c09854d63f40fc05a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:20Z,use_quota=True,user_id='9a29a5c076504e1186e1800d7f29e36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Creating volume 8454daa4-bcc3-4fd6-b680-d3b348f86697 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:14:20 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:20 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 1073741824 Sep 04 19:14:20 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:20 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 1073741824" returned: 0 in 0.572s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:21 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 Sep 04 19:14:21 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:21 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697" returned: 0 in 0.432s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:14:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667c77d3-f057-4143-803f-95e67a466028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8454daa4-bcc3-4fd6-b680-d3b348f86697', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3df803-d917-4f44-9d5d-4a985ed406c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:21 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Volume volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 (8454daa4-bcc3-4fd6-b680-d3b348f86697): created successfully Sep 04 19:14:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de3df803-d917-4f44-9d5d-4a985ed406c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Flow 'volume_create_manager' (f18317e7-6804-4704-a901-8e3fe4e86e36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:21 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b0847144-f1c0-4546-a2bd-0e3256ce0042 tempest-VolumesExtendTest-1028169703 None] Created volume successfully. Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Flow 'volume_create_manager' (227cc6d6-7a5a-412b-97e9-ac98c3f9677b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71e668e-cbde-4ecc-aa37-489f81cc8062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e71e668e-cbde-4ecc-aa37-489f81cc8062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-727966438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4aa87d4-dae5-4563-aeb8-2584f43d6f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab1c2fa06f14c5a81bcd8ba1d6b1916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:22Z,use_quota=True,user_id='ac75979ad02e4327ab7b07e04ae92bda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b15e47f9-32de-48f5-a7d8-97cbe397c702),volume_type_id=b15e47f9-32de-48f5-a7d8-97cbe397c702)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ef92df-fdd1-4dd9-b8dc-194ede1510c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26ef92df-fdd1-4dd9-b8dc-194ede1510c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621f780f-2b95-488f-a1dd-d0cee5a3c16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (621f780f-2b95-488f-a1dd-d0cee5a3c16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4aa87d4-dae5-4563-aeb8-2584f43d6f82', 'volume_name': 'volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75223dfc-b1a6-4228-9da6-789a817b399b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75223dfc-b1a6-4228-9da6-789a817b399b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8548cb41-1681-4359-a471-b84b77f29790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:22 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Volume d4aa87d4-dae5-4563-aeb8-2584f43d6f82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82', 'volume_size': 1} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-727966438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4aa87d4-dae5-4563-aeb8-2584f43d6f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab1c2fa06f14c5a81bcd8ba1d6b1916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:22Z,use_quota=True,user_id='ac75979ad02e4327ab7b07e04ae92bda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b15e47f9-32de-48f5-a7d8-97cbe397c702),volume_type_id=b15e47f9-32de-48f5-a7d8-97cbe397c702)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Creating volume d4aa87d4-dae5-4563-aeb8-2584f43d6f82 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:14:22 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:22 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82 1073741824 Sep 04 19:14:22 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Flow 'volume_create_manager' (903369c1-d857-466a-ab44-6c0c42264dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3d9c07-b9ae-48af-8102-3fd38e8d9b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3d9c07-b9ae-48af-8102-3fd38e8d9b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1340020507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb081c1-9b01-4e78-b948-4bf57ccddf80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab1c2fa06f14c5a81bcd8ba1d6b1916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:23Z,use_quota=True,user_id='ac75979ad02e4327ab7b07e04ae92bda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e6566de-6462-4b3d-bfd9-0cfda64cafa8),volume_type_id=7e6566de-6462-4b3d-bfd9-0cfda64cafa8)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4810b37-bd24-4d1e-a2c6-cbcc83f6cbbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4810b37-bd24-4d1e-a2c6-cbcc83f6cbbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (071de9b1-6060-40a5-ae4a-b270084049ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (071de9b1-6060-40a5-ae4a-b270084049ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bb081c1-9b01-4e78-b948-4bf57ccddf80', 'volume_name': 'volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee04397-fc59-4870-8b47-a8af3a57c8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ee04397-fc59-4870-8b47-a8af3a57c8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3308b8e9-ad4a-402e-a345-1fb1846f7a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:23 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Volume 2bb081c1-9b01-4e78-b948-4bf57ccddf80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80', 'volume_size': 1} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:23 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82 1073741824" returned: 0 in 0.649s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:23 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82 Sep 04 19:14:23 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:23 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82" returned: 0 in 0.371s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.608s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8548cb41-1681-4359-a471-b84b77f29790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527ed96e-d134-4f67-9180-ec5d07616a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] Creating offline snapshot 9823d624-7d19-4166-ad4e-a113ecd37a32 of volume 8454daa4-bcc3-4fd6-b680-d3b348f86697 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:14:23 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Volume volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82 (d4aa87d4-dae5-4563-aeb8-2584f43d6f82): created successfully Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (527ed96e-d134-4f67-9180-ec5d07616a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Flow 'volume_create_manager' (227cc6d6-7a5a-412b-97e9-ac98c3f9677b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d931183-3a8a-4b9a-971f-b48038550fa0]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:23 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fb067fc9-6b36-4b0b-9617-772fe0e8f098 tempest-TestInstancesWithCinderVolumes-576046077 None] Created volume successfully. Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Flow 'volume_create_manager' (292b1145-979b-4174-8b5d-98d97e2f58a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a828056b-4e02-4cb3-81c5-a1692d41ee0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a828056b-4e02-4cb3-81c5-a1692d41ee0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-876854299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0eb44d4-bb91-4b95-b3da-ce8fcc781177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab1c2fa06f14c5a81bcd8ba1d6b1916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:24Z,use_quota=True,user_id='ac75979ad02e4327ab7b07e04ae92bda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02eda969-a5c5-4823-8782-5250b3bb99dd),volume_type_id=02eda969-a5c5-4823-8782-5250b3bb99dd)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e82411b-147d-4331-991c-22c1a4f15e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e82411b-147d-4331-991c-22c1a4f15e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:23 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac17ced-329b-436f-ba2e-a7f6499d6bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:23 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 19:14:23 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac17ced-329b-436f-ba2e-a7f6499d6bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c0eb44d4-bb91-4b95-b3da-ce8fcc781177', 'volume_name': 'volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177', 'volume_size': 1, 'image_id': 'd1118067-e540-402c-8fd9-eec46fe49b31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1118067-e540-402c-8fd9-eec46fe49b31', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--67377338', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bab1c2fa06f14c5a81bcd8ba1d6b1916', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1118067-e540-402c-8fd9-eec46fe49b31', 'created_at': datetime.datetime(2026, 9, 4, 17, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 17, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1118067-e540-402c-8fd9-eec46fe49b31/file', 'properties': {}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:24 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9007a4f-ebb3-4772-8e19-1ec1021c5fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9007a4f-ebb3-4772-8e19-1ec1021c5fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc0d37f-261a-4702-a246-723b94768a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Volume c0eb44d4-bb91-4b95-b3da-ce8fcc781177: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177', 'volume_size': 1, 'image_id': 'd1118067-e540-402c-8fd9-eec46fe49b31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1118067-e540-402c-8fd9-eec46fe49b31', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--67377338', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bab1c2fa06f14c5a81bcd8ba1d6b1916', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1118067-e540-402c-8fd9-eec46fe49b31', 'created_at': datetime.datetime(2026, 9, 4, 17, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 17, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1118067-e540-402c-8fd9-eec46fe49b31/file', 'properties': {}}, 'image_service': } Sep 04 19:14:24 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Trying to clone c0eb44d4-bb91-4b95-b3da-ce8fcc781177 from image d1118067-e540-402c-8fd9-eec46fe49b31 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1118067-e540-402c-8fd9-eec46fe49b31', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 19:14:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697" returned: 0 in 0.465s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:24 devstack sudo[98121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 1G Sep 04 19:14:24 devstack sudo[98121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:24 devstack sudo[98121]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 1G" returned: 0 in 0.467s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:24 devstack sudo[98127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 Sep 04 19:14:24 devstack sudo[98127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:24 devstack sudo[98127]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32" returned: 0 in 0.323s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:24 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 is being set with open permissions: ugo+rw Sep 04 19:14:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:24 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 Sep 04 19:14:24 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:25 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32" returned: 0 in 0.292s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:25 devstack sudo[98135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.info Sep 04 19:14:25 devstack sudo[98135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:25 devstack sudo[98135]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.info" returned: 0 in 0.289s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:25 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.info is being set with open permissions: ugo+rw Sep 04 19:14:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:25 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.info Sep 04 19:14:25 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:25 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.info" returned: 0 in 0.281s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.741s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1340020507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bb081c1-9b01-4e78-b948-4bf57ccddf80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab1c2fa06f14c5a81bcd8ba1d6b1916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:23Z,use_quota=True,user_id='ac75979ad02e4327ab7b07e04ae92bda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e6566de-6462-4b3d-bfd9-0cfda64cafa8),volume_type_id=7e6566de-6462-4b3d-bfd9-0cfda64cafa8)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:14:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Creating volume 2bb081c1-9b01-4e78-b948-4bf57ccddf80 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:14:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:14:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:14:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:14:25 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:14:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:25 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80 1073741824 Sep 04 19:14:25 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-89cc5a7b-32ac-4678-acfc-66b3cc727624 tempest-VolumesExtendTest-1028169703 None] Create snapshot completed successfully Sep 04 19:14:26 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80 1073741824" returned: 0 in 0.523s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:26 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80 Sep 04 19:14:26 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:26 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:14:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3308b8e9-ad4a-402e-a345-1fb1846f7a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466855bb-ca63-4dad-b4d3-aad9de6f93c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:26 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Volume volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80 (2bb081c1-9b01-4e78-b948-4bf57ccddf80): created successfully Sep 04 19:14:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (466855bb-ca63-4dad-b4d3-aad9de6f93c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Flow 'volume_create_manager' (903369c1-d857-466a-ab44-6c0c42264dcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1d623d37-29a6-44a7-992d-98f9e8614553 tempest-TestInstancesWithCinderVolumes-576046077 None] Created volume successfully. Sep 04 19:14:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-98078eb9-5247-4935-a0a7-81da86681fbe tempest-VolumesExtendTest-1028169703 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-98078eb9-5247-4935-a0a7-81da86681fbe tempest-VolumesExtendTest-1028169703 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c55a8fc-e13d-4ff7-9c7f-6c310676fae6]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98078eb9-5247-4935-a0a7-81da86681fbe tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:27 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 Sep 04 19:14:27 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:27 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98078eb9-5247-4935-a0a7-81da86681fbe tempest-VolumesExtendTest-1028169703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697" returned: 0 in 0.449s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98078eb9-5247-4935-a0a7-81da86681fbe tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 2G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98078eb9-5247-4935-a0a7-81da86681fbe tempest-VolumesExtendTest-1028169703 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 2G" returned: 0 in 0.200s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-98078eb9-5247-4935-a0a7-81da86681fbe tempest-VolumesExtendTest-1028169703 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.711s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:27 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-98078eb9-5247-4935-a0a7-81da86681fbe tempest-VolumesExtendTest-1028169703 None] Extend volume completed successfully. Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1118067-e540-402c-8fd9-eec46fe49b31_ih8ve_bhdevstack@QuobyteHD, size 20.69 MB, duration 4.16 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 19:14:28 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Image download 20.69 MB at 4.97 MB/s Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f731cc48-2e67-4aee-97c4-368d3f81ce3d]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1118067-e540-402c-8fd9-eec46fe49b31_ih8ve_bhdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Acquiring lock "cinder-9823d624-7d19-4166-ad4e-a113ecd37a32-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Lock "cinder-9823d624-7d19-4166-ad4e-a113ecd37a32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Acquiring lock "cinder-quobyte-8454daa4-bcc3-4fd6-b680-d3b348f86697" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Lock "cinder-quobyte-8454daa4-bcc3-4fd6-b680-d3b348f86697" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Acquiring lock "cinder-quobyte-9823d624-7d19-4166-ad4e-a113ecd37a32" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Lock "cinder-quobyte-9823d624-7d19-4166-ad4e-a113ecd37a32" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Deleting offline snapshot 9823d624-7d19-4166-ad4e-a113ecd37a32 of volume 8454daa4-bcc3-4fd6-b680-d3b348f86697 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:14:28 devstack sudo[98178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1118067-e540-402c-8fd9-eec46fe49b31_ih8ve_bhdevstack@QuobyteHD Sep 04 19:14:28 devstack sudo[98178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] snapshot_file for this snap is: volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8135c80e-2a57-4f6a-a708-998b5f591ed4]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:28 devstack sudo[98180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 Sep 04 19:14:28 devstack sudo[98180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:28 devstack sudo[98178]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1118067-e540-402c-8fd9-eec46fe49b31_ih8ve_bhdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Temporary image d1118067-e540-402c-8fd9-eec46fe49b31 is fetched for user ac75979ad02e4327ab7b07e04ae92bda. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[46656071-e90b-48d3-8d07-8c8e36bccb8f]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1118067-e540-402c-8fd9-eec46fe49b31_ih8ve_bhdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:28 devstack sudo[98180]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32" returned: 0 in 0.502s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8454daa4-bcc3-4fd6-b680-d3b348f86697(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:14:28 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1118067-e540-402c-8fd9-eec46fe49b31_ih8ve_bhdevstack@QuobyteHD Sep 04 19:14:28 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce34cde-9420-4ec5-86e6-6fe8cf92dbb9]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:29 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 Sep 04 19:14:29 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:29 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1118067-e540-402c-8fd9-eec46fe49b31_ih8ve_bhdevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-876854299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0eb44d4-bb91-4b95-b3da-ce8fcc781177,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bab1c2fa06f14c5a81bcd8ba1d6b1916',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:24Z,use_quota=True,user_id='ac75979ad02e4327ab7b07e04ae92bda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02eda969-a5c5-4823-8782-5250b3bb99dd),volume_type_id=02eda969-a5c5-4823-8782-5250b3bb99dd)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Creating volume c0eb44d4-bb91-4b95-b3da-ce8fcc781177 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:14:29 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:29 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177 1073741824 Sep 04 19:14:29 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:29 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697" returned: 0 in 0.508s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:29 devstack sudo[98238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 Sep 04 19:14:29 devstack sudo[98238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:29 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177 1073741824" returned: 0 in 0.539s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:29 devstack sudo[98249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177 Sep 04 19:14:29 devstack sudo[98249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:29 devstack sudo[98238]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32" returned: 0 in 0.501s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:29 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32 Sep 04 19:14:30 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:30 devstack sudo[98249]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177" returned: 0 in 0.323s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:14:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:30 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Attempting download of d1118067-e540-402c-8fd9-eec46fe49b31 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1118067-e540-402c-8fd9-eec46fe49b31', 'metadata': {}}])) to volume c0eb44d4-bb91-4b95-b3da-ce8fcc781177. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 19:14:30 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7146c03c-511f-4245-831a-9af73140844e]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1118067-e540-402c-8fd9-eec46fe49b31_1g_yrczp {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:30 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697.9823d624-7d19-4166-ad4e-a113ecd37a32" returned: 0 in 0.506s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:30 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1118067-e540-402c-8fd9-eec46fe49b31_1g_yrczp Sep 04 19:14:30 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Lock "cinder-quobyte-9823d624-7d19-4166-ad4e-a113ecd37a32" released by "_delete_snapshot" :: held 2.176s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Lock "cinder-quobyte-8454daa4-bcc3-4fd6-b680-d3b348f86697" released by "delete_snapshot" :: held 2.207s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:30 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Created reservations ['f34184e5-9b9e-4ce9-a107-d2dcb51f71e8', 'cdba03d0-c0cf-4a26-a045-33df78ce800f', '4ffb7f82-156c-41e4-9bef-4dcb255d0892', '139e5ae1-e4a1-401e-8f0f-fe6f5b67e91a'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:14:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Delete snapshot completed successfully. Sep 04 19:14:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-6fbfb25f-fa88-4559-a493-afbbf59a06bf tempest-VolumesExtendTest-1028169703 None] Lock "cinder-9823d624-7d19-4166-ad4e-a113ecd37a32-delete_snapshot" released by "delete_snapshot" :: held 2.424s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:31 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1118067-e540-402c-8fd9-eec46fe49b31_1g_yrczp" returned: 0 in 0.729s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1118067-e540-402c-8fd9-eec46fe49b31_1g_yrczp {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:31 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1118067-e540-402c-8fd9-eec46fe49b31_1g_yrczp Sep 04 19:14:31 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:31 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1118067-e540-402c-8fd9-eec46fe49b31_1g_yrczp" returned: 1 in 0.426s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1118067-e540-402c-8fd9-eec46fe49b31_1g_yrczp' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:14:31 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6a5d9f-e7a0-480e-92b5-78d7e53cdb35]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1118067-e540-402c-8fd9-eec46fe49b31_ih8ve_bhdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:31 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1118067-e540-402c-8fd9-eec46fe49b31_ih8ve_bhdevstack@QuobyteHD Sep 04 19:14:31 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Acquiring lock "cinder-8454daa4-bcc3-4fd6-b680-d3b348f86697-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Lock "cinder-8454daa4-bcc3-4fd6-b680-d3b348f86697-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Acquiring lock "cinder-quobyte-8454daa4-bcc3-4fd6-b680-d3b348f86697" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Lock "cinder-quobyte-8454daa4-bcc3-4fd6-b680-d3b348f86697" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:31 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9ae8d8-0d28-49cc-becc-aa7f9c38ac6c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:31 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1118067-e540-402c-8fd9-eec46fe49b31_ih8ve_bhdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:31 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] d1118067-e540-402c-8fd9-eec46fe49b31 was qcow2, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 19:14:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1118067-e540-402c-8fd9-eec46fe49b31_ih8ve_bhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:32 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1118067-e540-402c-8fd9-eec46fe49b31_ih8ve_bhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177 Sep 04 19:14:32 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:32 devstack sudo[98336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 Sep 04 19:14:32 devstack sudo[98336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:32 devstack sudo[98336]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697" returned: 0 in 0.579s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:32 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697 Sep 04 19:14:32 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:32 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8454daa4-bcc3-4fd6-b680-d3b348f86697" returned: 0 in 0.270s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Lock "cinder-quobyte-8454daa4-bcc3-4fd6-b680-d3b348f86697" released by "delete_volume" :: held 0.942s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:32 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Created reservations ['92e6fc70-c59f-4819-ae7a-5a960aa540db', 'b6f3691b-e551-499a-a269-8d66c2e76e90', '40083f7a-ccd5-46d5-bee8-d148eb347a1b', '66663307-6a54-4d08-91b9-d462bfa51d38'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:14:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:14:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:14:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:32 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:14:32 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:33 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.316s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:33 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:14:33 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Deleted volume successfully. Sep 04 19:14:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ae30a8ec-4cca-494b-bf88-59d5b936951b tempest-VolumesExtendTest-1028169703 None] Lock "cinder-8454daa4-bcc3-4fd6-b680-d3b348f86697-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:34 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1118067-e540-402c-8fd9-eec46fe49b31_ih8ve_bhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177" returned: 0 in 2.108s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1118067-e540-402c-8fd9-eec46fe49b31_ih8ve_bhdevstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:14:34 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Converted 112.00 MB image at 53.11 MB/s Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:34 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177 1G Sep 04 19:14:34 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Flow 'volume_create_manager' (42f453a1-54af-443b-968d-084ab1d6bfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8db50f-2a1a-42db-aa73-5d2ca3d03608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f8db50f-2a1a-42db-aa73-5d2ca3d03608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1163185627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf78cc4-bd05-474a-b823-48b775fc3637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aacb7e351f44719a83463f5d03c284e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:34Z,use_quota=True,user_id='d18f4bc69187485d9984d5a94394333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231b3396-b742-4bfa-82b7-8b5255b7f1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (231b3396-b742-4bfa-82b7-8b5255b7f1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1488d188-0742-4dd8-9f7a-a390d47c74a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1488d188-0742-4dd8-9f7a-a390d47c74a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbf78cc4-bd05-474a-b823-48b775fc3637', 'volume_name': 'volume-fbf78cc4-bd05-474a-b823-48b775fc3637', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2679007-ffed-4a83-b92c-a1057f2598d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2679007-ffed-4a83-b92c-a1057f2598d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a71f4d-caf0-4650-8c59-48716988f6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:34 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Volume fbf78cc4-bd05-474a-b823-48b775fc3637: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbf78cc4-bd05-474a-b823-48b775fc3637', 'volume_size': 1} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1163185627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbf78cc4-bd05-474a-b823-48b775fc3637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aacb7e351f44719a83463f5d03c284e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:34Z,use_quota=True,user_id='d18f4bc69187485d9984d5a94394333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Creating volume fbf78cc4-bd05-474a-b823-48b775fc3637 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:14:34 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fbf78cc4-bd05-474a-b823-48b775fc3637 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:34 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fbf78cc4-bd05-474a-b823-48b775fc3637 1073741824 Sep 04 19:14:34 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:34 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177 1G" returned: 0 in 0.460s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Downloaded image d1118067-e540-402c-8fd9-eec46fe49b31 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1118067-e540-402c-8fd9-eec46fe49b31', 'metadata': {}}])) to volume c0eb44d4-bb91-4b95-b3da-ce8fcc781177 successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Temporary image d1118067-e540-402c-8fd9-eec46fe49b31 for user ac75979ad02e4327ab7b07e04ae92bda is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Marking volume c0eb44d4-bb91-4b95-b3da-ce8fcc781177 as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Copying metadata from image d1118067-e540-402c-8fd9-eec46fe49b31 to c0eb44d4-bb91-4b95-b3da-ce8fcc781177. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Creating volume glance metadata for volume c0eb44d4-bb91-4b95-b3da-ce8fcc781177 backed by image d1118067-e540-402c-8fd9-eec46fe49b31 with: {'image_id': 'd1118067-e540-402c-8fd9-eec46fe49b31', 'image_name': 'tempest-scenario-img--67377338', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfc0d37f-261a-4702-a246-723b94768a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177', 'volume_size': 1, 'image_id': 'd1118067-e540-402c-8fd9-eec46fe49b31', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1118067-e540-402c-8fd9-eec46fe49b31', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--67377338', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bab1c2fa06f14c5a81bcd8ba1d6b1916', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1118067-e540-402c-8fd9-eec46fe49b31', 'created_at': datetime.datetime(2026, 9, 4, 17, 14, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 17, 14, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1118067-e540-402c-8fd9-eec46fe49b31/file', 'properties': {}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ef7ee1-be2b-4125-801d-31bdb44e3f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:34 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Volume volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177 (c0eb44d4-bb91-4b95-b3da-ce8fcc781177): created successfully Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38ef7ee1-be2b-4125-801d-31bdb44e3f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Flow 'volume_create_manager' (292b1145-979b-4174-8b5d-98d97e2f58a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-810d7fce-cba8-488a-98d5-2de99f5ac5e4 tempest-TestInstancesWithCinderVolumes-576046077 None] Created volume successfully. Sep 04 19:14:34 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fbf78cc4-bd05-474a-b823-48b775fc3637 1073741824" returned: 0 in 0.519s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fbf78cc4-bd05-474a-b823-48b775fc3637 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:35 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fbf78cc4-bd05-474a-b823-48b775fc3637 Sep 04 19:14:35 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:35 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fbf78cc4-bd05-474a-b823-48b775fc3637" returned: 0 in 0.272s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:14:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2a71f4d-caf0-4650-8c59-48716988f6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbf78cc4-bd05-474a-b823-48b775fc3637', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0180cf45-5290-4f3b-ac29-7a7c8cdc223a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:35 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Volume volume-fbf78cc4-bd05-474a-b823-48b775fc3637 (fbf78cc4-bd05-474a-b823-48b775fc3637): created successfully Sep 04 19:14:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0180cf45-5290-4f3b-ac29-7a7c8cdc223a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Flow 'volume_create_manager' (42f453a1-54af-443b-968d-084ab1d6bfa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-903da994-4d8b-4787-a4b3-d28373beed1e tempest-VolumesActionsTest-329184483 None] Created volume successfully. Sep 04 19:14:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9928f8e4-7aae-462c-9cc5-c46bbcbfcb1b tempest-VolumesActionsTest-329184483 None] Acquiring lock "cinder-fbf78cc4-bd05-474a-b823-48b775fc3637" by "attach_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9928f8e4-7aae-462c-9cc5-c46bbcbfcb1b tempest-VolumesActionsTest-329184483 None] Lock "cinder-fbf78cc4-bd05-474a-b823-48b775fc3637" acquired by "attach_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9928f8e4-7aae-462c-9cc5-c46bbcbfcb1b tempest-VolumesActionsTest-329184483 None] Attaching volume fbf78cc4-bd05-474a-b823-48b775fc3637 to instance 3c096719-1003-4f6e-a37f-49c2add9e6da at mountpoint /dev/vdb on host None. Sep 04 19:14:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9928f8e4-7aae-462c-9cc5-c46bbcbfcb1b tempest-VolumesActionsTest-329184483 None] Attach volume completed successfully. Sep 04 19:14:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9928f8e4-7aae-462c-9cc5-c46bbcbfcb1b tempest-VolumesActionsTest-329184483 None] Lock "cinder-fbf78cc4-bd05-474a-b823-48b775fc3637" released by "attach_volume" :: held 0.126s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dc3d8335-b112-451a-bfe3-f1503401c23d tempest-VolumesActionsTest-1838748227 None] Terminate volume connection completed successfully. Sep 04 19:14:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dc3d8335-b112-451a-bfe3-f1503401c23d tempest-VolumesActionsTest-1838748227 None] Acquiring lock "cinder-fbf78cc4-bd05-474a-b823-48b775fc3637-detach_volume" by "detach_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dc3d8335-b112-451a-bfe3-f1503401c23d tempest-VolumesActionsTest-1838748227 None] Lock "cinder-fbf78cc4-bd05-474a-b823-48b775fc3637-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dc3d8335-b112-451a-bfe3-f1503401c23d tempest-VolumesActionsTest-1838748227 None] Detaching volume fbf78cc4-bd05-474a-b823-48b775fc3637 from instance 3c096719-1003-4f6e-a37f-49c2add9e6da. Sep 04 19:14:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dc3d8335-b112-451a-bfe3-f1503401c23d tempest-VolumesActionsTest-1838748227 None] Detach volume completed successfully. Sep 04 19:14:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dc3d8335-b112-451a-bfe3-f1503401c23d tempest-VolumesActionsTest-1838748227 None] Lock "cinder-fbf78cc4-bd05-474a-b823-48b775fc3637-detach_volume" released by "detach_volume" :: held 0.085s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-145f2109-f636-41ed-a2a1-34b288c4688c tempest-VolumesActionsTest-329184483 None] Acquiring lock "cinder-fbf78cc4-bd05-474a-b823-48b775fc3637-detach_volume" by "detach_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-145f2109-f636-41ed-a2a1-34b288c4688c tempest-VolumesActionsTest-329184483 None] Lock "cinder-fbf78cc4-bd05-474a-b823-48b775fc3637-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-145f2109-f636-41ed-a2a1-34b288c4688c tempest-VolumesActionsTest-329184483 None] Volume detach called, but volume not attached. Sep 04 19:14:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-145f2109-f636-41ed-a2a1-34b288c4688c tempest-VolumesActionsTest-329184483 None] Lock "cinder-fbf78cc4-bd05-474a-b823-48b775fc3637-detach_volume" released by "detach_volume" :: held 0.038s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Acquiring lock "cinder-fbf78cc4-bd05-474a-b823-48b775fc3637-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Lock "cinder-fbf78cc4-bd05-474a-b823-48b775fc3637-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Acquiring lock "cinder-quobyte-fbf78cc4-bd05-474a-b823-48b775fc3637" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Lock "cinder-quobyte-fbf78cc4-bd05-474a-b823-48b775fc3637" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:38 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea38cefe-9c3f-4b0b-bea9-e635947fca38]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fbf78cc4-bd05-474a-b823-48b775fc3637 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:38 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fbf78cc4-bd05-474a-b823-48b775fc3637 Sep 04 19:14:38 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:38 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fbf78cc4-bd05-474a-b823-48b775fc3637" returned: 0 in 0.527s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fbf78cc4-bd05-474a-b823-48b775fc3637 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:39 devstack sudo[98378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fbf78cc4-bd05-474a-b823-48b775fc3637 Sep 04 19:14:39 devstack sudo[98378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:39 devstack sudo[98378]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fbf78cc4-bd05-474a-b823-48b775fc3637" returned: 0 in 0.483s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Lock "cinder-quobyte-fbf78cc4-bd05-474a-b823-48b775fc3637" released by "delete_volume" :: held 1.059s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:39 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Created reservations ['a9bbf42e-05b8-4c8a-8377-b0770ffc4ccf', 'b4130187-ee50-48de-a14d-2453d5b0ecb5', 'c8c0fe92-08c1-4dec-aed5-3766475600fd', '7a634198-6dab-4723-b4de-062f3e911b2a'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:14:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:14:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:14:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:39 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:14:39 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-2f8f3f32-76ca-4f5c-be3d-05aa5835662c req-9f1bb0aa-4671-4e1d-b68f-da0da89e50a7 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-2f8f3f32-76ca-4f5c-be3d-05aa5835662c req-9f1bb0aa-4671-4e1d-b68f-da0da89e50a7 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-2f8f3f32-76ca-4f5c-be3d-05aa5835662c req-9f1bb0aa-4671-4e1d-b68f-da0da89e50a7 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-2f8f3f32-76ca-4f5c-be3d-05aa5835662c req-9f1bb0aa-4671-4e1d-b68f-da0da89e50a7 tempest-TestInstancesWithCinderVolumes-576046077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bab96f98-277a-4f48-98e6-6a4a2af69132', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:14:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-2f8f3f32-76ca-4f5c-be3d-05aa5835662c req-9f1bb0aa-4671-4e1d-b68f-da0da89e50a7 tempest-TestInstancesWithCinderVolumes-576046077 None] attachment_update completed successfully. Sep 04 19:14:40 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.600s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:40 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:14:40 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Deleted volume successfully. Sep 04 19:14:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-eaaffda6-d85e-45c5-bf59-c104ac78788d tempest-VolumesActionsTest-329184483 None] Lock "cinder-fbf78cc4-bd05-474a-b823-48b775fc3637-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Flow 'volume_create_manager' (36f23f02-49fa-4475-b5be-00d032147afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e430633-80f0-4cce-8e9e-2278351458d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e430633-80f0-4cce-8e9e-2278351458d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2117156266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e236489-2d2d-4dc5-9ea7-c8e9e6a78975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02b7070fbda4f4599b808c0b2c85de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:42Z,use_quota=True,user_id='3d93514fb5f34ca79a2c7be97028d91c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a17136-2f05-4cae-89d7-5d80d82375c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61a17136-2f05-4cae-89d7-5d80d82375c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3b0861-149c-4190-a9e6-794d75910107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d3b0861-149c-4190-a9e6-794d75910107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e236489-2d2d-4dc5-9ea7-c8e9e6a78975', 'volume_name': 'volume-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9790ec3-34fa-485d-84f4-9f9b272dedde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9790ec3-34fa-485d-84f4-9f9b272dedde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75fe0ca-d171-46dd-aa3e-879070086d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:42 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Volume 9e236489-2d2d-4dc5-9ea7-c8e9e6a78975: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975', 'volume_size': 1} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2117156266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e236489-2d2d-4dc5-9ea7-c8e9e6a78975,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b02b7070fbda4f4599b808c0b2c85de3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:42Z,use_quota=True,user_id='3d93514fb5f34ca79a2c7be97028d91c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Creating volume 9e236489-2d2d-4dc5-9ea7-c8e9e6a78975 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:14:42 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:42 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975 1073741824 Sep 04 19:14:42 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:42 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975 1073741824" returned: 0 in 0.591s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:42 devstack sudo[98426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975 Sep 04 19:14:42 devstack sudo[98426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:43 devstack sudo[98426]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975" returned: 0 in 0.285s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:14:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c75fe0ca-d171-46dd-aa3e-879070086d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f76b38-cd28-4f83-be52-fd875b57db57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:43 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Volume volume-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975 (9e236489-2d2d-4dc5-9ea7-c8e9e6a78975): created successfully Sep 04 19:14:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f76b38-cd28-4f83-be52-fd875b57db57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Flow 'volume_create_manager' (36f23f02-49fa-4475-b5be-00d032147afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9be109b1-232f-44a3-91fc-3fc5f4a33772 tempest-VolumesNegativeTest-1584702626 None] Created volume successfully. Sep 04 19:14:44 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:14:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Flow 'volume_create_manager' (6ab85146-ab8c-4f3f-91f0-fed5fb29e86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9d06d8-3247-4822-89be-c069c772cb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac9d06d8-3247-4822-89be-c069c772cb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-385947862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba292ee9-8708-4e10-8a89-d8aa07d6ff6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aacb7e351f44719a83463f5d03c284e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:45Z,use_quota=True,user_id='d18f4bc69187485d9984d5a94394333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b37e5ec-ca1f-49f0-af78-dbb164e0aa0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b37e5ec-ca1f-49f0-af78-dbb164e0aa0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686bb693-00cf-43f9-9c3c-5ad95de7158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686bb693-00cf-43f9-9c3c-5ad95de7158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba292ee9-8708-4e10-8a89-d8aa07d6ff6b', 'volume_name': 'volume-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a036371-8c09-47bd-9baf-c427a6092945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a036371-8c09-47bd-9baf-c427a6092945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc60fbc-52b6-4319-ad5c-c1ab3c699e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:44 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Volume ba292ee9-8708-4e10-8a89-d8aa07d6ff6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b', 'volume_size': 1} Sep 04 19:14:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-385947862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba292ee9-8708-4e10-8a89-d8aa07d6ff6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aacb7e351f44719a83463f5d03c284e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:45Z,use_quota=True,user_id='d18f4bc69187485d9984d5a94394333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:14:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Creating volume ba292ee9-8708-4e10-8a89-d8aa07d6ff6b {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:14:45 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:45 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b 1073741824 Sep 04 19:14:45 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:45 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:14:45 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:45 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.343s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:14:45 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b 1073741824" returned: 0 in 0.646s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:45 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b Sep 04 19:14:45 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:46 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b" returned: 0 in 0.418s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:14:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcc60fbc-52b6-4319-ad5c-c1ab3c699e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1eaddbc-bef9-43e5-99c5-e9a074935022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:46 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Volume volume-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b (ba292ee9-8708-4e10-8a89-d8aa07d6ff6b): created successfully Sep 04 19:14:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1eaddbc-bef9-43e5-99c5-e9a074935022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Flow 'volume_create_manager' (6ab85146-ab8c-4f3f-91f0-fed5fb29e86b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-da69eaf2-9c5e-4c9f-a528-94757eea0fbc tempest-VolumesActionsTest-329184483 None] Created volume successfully. Sep 04 19:14:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Acquiring lock "cinder-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Lock "cinder-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Acquiring lock "cinder-quobyte-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Lock "cinder-quobyte-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b" acquired by "delete_volume" :: waited 0.052s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fc68fa-2b46-4076-88bf-b39a3d8de2d1]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:47 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b Sep 04 19:14:47 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:48 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b" returned: 0 in 0.857s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:48 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b Sep 04 19:14:48 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:49 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b" returned: 0 in 0.608s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Lock "cinder-quobyte-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b" released by "delete_volume" :: held 1.614s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:49 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Created reservations ['5f3fca0a-d6aa-481e-900d-942e7cf58803', '020540b3-67ad-4323-86a1-b867f9be26b2', '1bcb71ab-ff17-408d-9c18-ab8c0e634036', 'b93c42fc-1df1-4cd6-bf80-d68a76b44631'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:14:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:14:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:14:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:49 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:14:49 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:49 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.380s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:49 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:14:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Deleted volume successfully. Sep 04 19:14:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-50dc1ed2-c263-48c8-8ea6-a91716ec05b0 tempest-VolumesActionsTest-1838748227 None] Lock "cinder-ba292ee9-8708-4e10-8a89-d8aa07d6ff6b-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Flow 'volume_create_manager' (252abca5-feca-4663-a5ba-695c6f83616b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bcbb62-49eb-439d-b651-e186d016c882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41bcbb62-49eb-439d-b651-e186d016c882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1989541987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939678d3-39a1-473b-bf23-a8e789627e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aacb7e351f44719a83463f5d03c284e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:51Z,use_quota=True,user_id='d18f4bc69187485d9984d5a94394333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01621c68-1365-4fbc-ab12-b50ea8eec2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01621c68-1365-4fbc-ab12-b50ea8eec2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0288772-b096-49c0-951c-55202ec9f60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0288772-b096-49c0-951c-55202ec9f60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '939678d3-39a1-473b-bf23-a8e789627e8e', 'volume_name': 'volume-939678d3-39a1-473b-bf23-a8e789627e8e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631e3893-ef27-4519-b962-aff2aad547af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631e3893-ef27-4519-b962-aff2aad547af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8876b8c5-2a07-4417-b57c-d6e411ed55ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:50 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Volume 939678d3-39a1-473b-bf23-a8e789627e8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-939678d3-39a1-473b-bf23-a8e789627e8e', 'volume_size': 1} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1989541987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=939678d3-39a1-473b-bf23-a8e789627e8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aacb7e351f44719a83463f5d03c284e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:51Z,use_quota=True,user_id='d18f4bc69187485d9984d5a94394333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Creating volume 939678d3-39a1-473b-bf23-a8e789627e8e {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:14:50 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:14:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-939678d3-39a1-473b-bf23-a8e789627e8e 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:50 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-939678d3-39a1-473b-bf23-a8e789627e8e 1073741824 Sep 04 19:14:50 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:51 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-939678d3-39a1-473b-bf23-a8e789627e8e 1073741824" returned: 0 in 0.655s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-939678d3-39a1-473b-bf23-a8e789627e8e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:51 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-939678d3-39a1-473b-bf23-a8e789627e8e Sep 04 19:14:51 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:51 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-939678d3-39a1-473b-bf23-a8e789627e8e" returned: 0 in 0.542s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:51 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] <== create_volume: return (1281ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:14:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8876b8c5-2a07-4417-b57c-d6e411ed55ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-939678d3-39a1-473b-bf23-a8e789627e8e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311248ad-326e-4192-b052-95a6fc1d8970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:52 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Volume volume-939678d3-39a1-473b-bf23-a8e789627e8e (939678d3-39a1-473b-bf23-a8e789627e8e): created successfully Sep 04 19:14:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311248ad-326e-4192-b052-95a6fc1d8970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Flow 'volume_create_manager' (252abca5-feca-4663-a5ba-695c6f83616b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-703db63b-f8d4-47f0-830e-d4510f45832a tempest-VolumesActionsTest-329184483 None] Created volume successfully. Sep 04 19:14:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Acquiring lock "cinder-939678d3-39a1-473b-bf23-a8e789627e8e-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Lock "cinder-939678d3-39a1-473b-bf23-a8e789627e8e-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Acquiring lock "cinder-quobyte-939678d3-39a1-473b-bf23-a8e789627e8e" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Lock "cinder-quobyte-939678d3-39a1-473b-bf23-a8e789627e8e" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:54 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31eb233-ec7c-462f-bd3f-35fd4d345e7f]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-939678d3-39a1-473b-bf23-a8e789627e8e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:54 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-939678d3-39a1-473b-bf23-a8e789627e8e Sep 04 19:14:54 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:54 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-939678d3-39a1-473b-bf23-a8e789627e8e" returned: 0 in 0.744s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-939678d3-39a1-473b-bf23-a8e789627e8e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:54 devstack sudo[99019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-939678d3-39a1-473b-bf23-a8e789627e8e Sep 04 19:14:54 devstack sudo[99019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:55 devstack sudo[99019]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-939678d3-39a1-473b-bf23-a8e789627e8e" returned: 0 in 0.650s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Lock "cinder-quobyte-939678d3-39a1-473b-bf23-a8e789627e8e" released by "delete_volume" :: held 1.469s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:55 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Created reservations ['c2ec208a-3044-457d-b714-66056d14d2e2', 'b2f53909-8a44-48b0-8220-4d6e12fe6ee8', '6a9e63e4-733e-49ca-97e6-f968d0afeaf9', 'a07d2586-aeb5-4bb0-99e2-b8ca3a97fc63'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:14:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:14:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:14:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:55 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:14:55 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:55 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.339s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:55 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:14:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Deleted volume successfully. Sep 04 19:14:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1dd2ab69-8b4f-4363-adcc-cb833f4a75bb tempest-VolumesActionsTest-1838748227 None] Lock "cinder-939678d3-39a1-473b-bf23-a8e789627e8e-delete_volume" released by "delete_volume" :: held 2.226s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Flow 'volume_create_manager' (3eb8b9cf-797f-4c68-8333-870ea14e7513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166a14f0-a263-4854-8262-40377530926c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166a14f0-a263-4854-8262-40377530926c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1418811079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf25c1db-fa0b-4551-9199-dcaf993bd313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aacb7e351f44719a83463f5d03c284e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:57Z,use_quota=True,user_id='d18f4bc69187485d9984d5a94394333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4229b025-0c94-4932-8738-70379738e850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4229b025-0c94-4932-8738-70379738e850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25b3ebc-0770-4b53-89b1-ce84a7192c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a25b3ebc-0770-4b53-89b1-ce84a7192c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf25c1db-fa0b-4551-9199-dcaf993bd313', 'volume_name': 'volume-bf25c1db-fa0b-4551-9199-dcaf993bd313', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0063bc4-476f-4f39-b270-1c9420655669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0063bc4-476f-4f39-b270-1c9420655669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142629e3-2e0a-4cc8-97f1-bb14179e335b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:57 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Volume bf25c1db-fa0b-4551-9199-dcaf993bd313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf25c1db-fa0b-4551-9199-dcaf993bd313', 'volume_size': 1} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1418811079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf25c1db-fa0b-4551-9199-dcaf993bd313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aacb7e351f44719a83463f5d03c284e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:14:57Z,use_quota=True,user_id='d18f4bc69187485d9984d5a94394333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Creating volume bf25c1db-fa0b-4551-9199-dcaf993bd313 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:14:57 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:14:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf25c1db-fa0b-4551-9199-dcaf993bd313 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:57 devstack sudo[99039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf25c1db-fa0b-4551-9199-dcaf993bd313 1073741824 Sep 04 19:14:57 devstack sudo[99039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:58 devstack sudo[99039]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf25c1db-fa0b-4551-9199-dcaf993bd313 1073741824" returned: 0 in 0.762s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf25c1db-fa0b-4551-9199-dcaf993bd313 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:58 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf25c1db-fa0b-4551-9199-dcaf993bd313 Sep 04 19:14:58 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:14:58 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Sep 04 19:14:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf25c1db-fa0b-4551-9199-dcaf993bd313" returned: 0 in 0.531s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:14:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:14:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:14:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142629e3-2e0a-4cc8-97f1-bb14179e335b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf25c1db-fa0b-4551-9199-dcaf993bd313', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73683c00-aaba-4c6f-9ea8-3b808bcc9317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:14:58 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Volume volume-bf25c1db-fa0b-4551-9199-dcaf993bd313 (bf25c1db-fa0b-4551-9199-dcaf993bd313): created successfully Sep 04 19:14:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73683c00-aaba-4c6f-9ea8-3b808bcc9317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:14:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Flow 'volume_create_manager' (3eb8b9cf-797f-4c68-8333-870ea14e7513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:14:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-31983365-b55c-4cd7-931e-16436eb5a2e2 tempest-VolumesActionsTest-329184483 None] Created volume successfully. Sep 04 19:14:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Acquiring lock "cinder-bf25c1db-fa0b-4551-9199-dcaf993bd313-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Lock "cinder-bf25c1db-fa0b-4551-9199-dcaf993bd313-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Acquiring lock "cinder-quobyte-bf25c1db-fa0b-4551-9199-dcaf993bd313" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:14:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Lock "cinder-quobyte-bf25c1db-fa0b-4551-9199-dcaf993bd313" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:14:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba976602-9297-49bc-ba33-da5a6a31e145]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:14:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf25c1db-fa0b-4551-9199-dcaf993bd313 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:14:59 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf25c1db-fa0b-4551-9199-dcaf993bd313 Sep 04 19:14:59 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:00 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf25c1db-fa0b-4551-9199-dcaf993bd313" returned: 0 in 0.353s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf25c1db-fa0b-4551-9199-dcaf993bd313 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:00 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf25c1db-fa0b-4551-9199-dcaf993bd313 Sep 04 19:15:00 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:00 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bf25c1db-fa0b-4551-9199-dcaf993bd313" returned: 0 in 0.278s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Lock "cinder-quobyte-bf25c1db-fa0b-4551-9199-dcaf993bd313" released by "delete_volume" :: held 0.675s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:00 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Created reservations ['fb032dfc-4690-49a8-9011-1cdf1f9c7cf6', 'd2c74bb1-a54a-407a-bbb2-ae4591701a7b', '3b98f640-f08a-43fa-94a6-03d617eb4ac8', 'bfd8dd9b-4dfd-4e0c-96a7-3e2c8b758777'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:15:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:00 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:15:00 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:00 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.258s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:00 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:15:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Deleted volume successfully. Sep 04 19:15:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-fa48f04d-1774-44bd-880d-77f3c2bd7bba tempest-VolumesActionsTest-1838748227 None] Lock "cinder-bf25c1db-fa0b-4551-9199-dcaf993bd313-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Flow 'volume_create_manager' (d7878fc4-5d7b-44be-ba32-d27bead53bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea0f58c-96f7-4558-bf90-e655b84105ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea0f58c-96f7-4558-bf90-e655b84105ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1089051463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc44d4c-89bb-4f62-bb41-621e7df4876c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aacb7e351f44719a83463f5d03c284e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:01Z,use_quota=True,user_id='d18f4bc69187485d9984d5a94394333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d179d98-637f-4384-9218-b614ec917f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d179d98-637f-4384-9218-b614ec917f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fe5366-7c4d-4511-9b47-d7dcbc7537a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91fe5366-7c4d-4511-9b47-d7dcbc7537a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fc44d4c-89bb-4f62-bb41-621e7df4876c', 'volume_name': 'volume-4fc44d4c-89bb-4f62-bb41-621e7df4876c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b491d73e-33da-4fc4-83ce-15c828543b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b491d73e-33da-4fc4-83ce-15c828543b2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551940e2-58e4-4c04-9c48-a89ae5052ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:01 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Volume 4fc44d4c-89bb-4f62-bb41-621e7df4876c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fc44d4c-89bb-4f62-bb41-621e7df4876c', 'volume_size': 1} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1089051463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fc44d4c-89bb-4f62-bb41-621e7df4876c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aacb7e351f44719a83463f5d03c284e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:01Z,use_quota=True,user_id='d18f4bc69187485d9984d5a94394333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Creating volume 4fc44d4c-89bb-4f62-bb41-621e7df4876c {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:15:01 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-4fc44d4c-89bb-4f62-bb41-621e7df4876c 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:01 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-4fc44d4c-89bb-4f62-bb41-621e7df4876c 1073741824 Sep 04 19:15:01 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:01 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-4fc44d4c-89bb-4f62-bb41-621e7df4876c 1073741824" returned: 0 in 0.449s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-4fc44d4c-89bb-4f62-bb41-621e7df4876c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:01 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-4fc44d4c-89bb-4f62-bb41-621e7df4876c Sep 04 19:15:01 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:02 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-4fc44d4c-89bb-4f62-bb41-621e7df4876c" returned: 0 in 0.278s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:15:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (551940e2-58e4-4c04-9c48-a89ae5052ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fc44d4c-89bb-4f62-bb41-621e7df4876c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129b8047-3f27-480d-9e25-2cd9d267b544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:02 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Volume volume-4fc44d4c-89bb-4f62-bb41-621e7df4876c (4fc44d4c-89bb-4f62-bb41-621e7df4876c): created successfully Sep 04 19:15:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (129b8047-3f27-480d-9e25-2cd9d267b544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:02 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Flow 'volume_create_manager' (d7878fc4-5d7b-44be-ba32-d27bead53bfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:15:02 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-29047576-f0de-4115-ae22-8eef803697e1 tempest-VolumesActionsTest-329184483 None] Created volume successfully. Sep 04 19:15:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Acquiring lock "cinder-4fc44d4c-89bb-4f62-bb41-621e7df4876c-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Lock "cinder-4fc44d4c-89bb-4f62-bb41-621e7df4876c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Acquiring lock "cinder-quobyte-4fc44d4c-89bb-4f62-bb41-621e7df4876c" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Lock "cinder-quobyte-4fc44d4c-89bb-4f62-bb41-621e7df4876c" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:03 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d4783b-dc9e-4ee6-abd2-13d1a4649627]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-4fc44d4c-89bb-4f62-bb41-621e7df4876c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:03 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-4fc44d4c-89bb-4f62-bb41-621e7df4876c Sep 04 19:15:03 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:04 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-4fc44d4c-89bb-4f62-bb41-621e7df4876c" returned: 0 in 0.370s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-4fc44d4c-89bb-4f62-bb41-621e7df4876c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:04 devstack sudo[99125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-4fc44d4c-89bb-4f62-bb41-621e7df4876c Sep 04 19:15:04 devstack sudo[99125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:04 devstack sudo[99125]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-4fc44d4c-89bb-4f62-bb41-621e7df4876c" returned: 0 in 0.243s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Lock "cinder-quobyte-4fc44d4c-89bb-4f62-bb41-621e7df4876c" released by "delete_volume" :: held 0.655s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:04 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Created reservations ['88cb1a6f-2b09-4aa8-9c5f-b8f205e46c14', '634cdb1a-654c-4391-891c-03bf1037fce4', 'bb1096f6-2942-4f68-940d-14d780e47332', '48c60f52-3813-44e4-aa2f-7d95bbb38b4f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:15:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:04 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:15:04 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:04 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.287s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:04 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:15:04 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Deleted volume successfully. Sep 04 19:15:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bea09bcc-351e-47ba-be22-a75e6a3d456d tempest-VolumesActionsTest-1838748227 None] Lock "cinder-4fc44d4c-89bb-4f62-bb41-621e7df4876c-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=111,cinder:SELECT=101,cinder:INSERT=30,cinder:DELETE=11 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=93,cinder:INSERT=38,cinder:UPDATE=109,cinder:DELETE=8 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Flow 'volume_create_manager' (6a6c64d4-586d-439c-aea3-bdb2b0c070ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b460ff3-cd2f-4114-b20d-b41b9b889082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b460ff3-cd2f-4114-b20d-b41b9b889082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1227147403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aacb7e351f44719a83463f5d03c284e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:05Z,use_quota=True,user_id='d18f4bc69187485d9984d5a94394333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e74a76-0ebd-4449-bbd8-d8cf32ef4e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e74a76-0ebd-4449-bbd8-d8cf32ef4e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bfbb35f-4c09-4e1c-a6ac-8bc7d6d4ddef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bfbb35f-4c09-4e1c-a6ac-8bc7d6d4ddef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97', 'volume_name': 'volume-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e74034-fa6f-4494-b623-c1441012ffc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7e74034-fa6f-4494-b623-c1441012ffc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562b9686-dd16-462e-a40c-7c313491e5b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:05 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Volume 6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97', 'volume_size': 1} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1227147403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5aacb7e351f44719a83463f5d03c284e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:05Z,use_quota=True,user_id='d18f4bc69187485d9984d5a94394333d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Creating volume 6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:15:05 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:05 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97 1073741824 Sep 04 19:15:05 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:05 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97 1073741824" returned: 0 in 0.434s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:05 devstack sudo[99138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97 Sep 04 19:15:05 devstack sudo[99138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:06 devstack sudo[99138]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97" returned: 0 in 0.243s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562b9686-dd16-462e-a40c-7c313491e5b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0919285-dcef-4ab5-98d1-34ae72ecdb0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:06 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Volume volume-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97 (6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97): created successfully Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0919285-dcef-4ab5-98d1-34ae72ecdb0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Flow 'volume_create_manager' (6a6c64d4-586d-439c-aea3-bdb2b0c070ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:15:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-30c47c84-15f8-476a-95f6-2f13766e65cf tempest-VolumesActionsTest-329184483 None] Created volume successfully. Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Acquiring lock "cinder-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Lock "cinder-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Acquiring lock "cinder-quobyte-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Lock "cinder-quobyte-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5afddc7-bb01-459b-ba09-f3a749b371e4]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:06 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975 Sep 04 19:15:06 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Acquiring lock "cinder-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Lock "cinder-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Acquiring lock "cinder-quobyte-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Lock "cinder-quobyte-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:07 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975" returned: 0 in 0.383s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[93fe83e8-9869-4925-9d85-c23ecd91767a]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:07 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975 Sep 04 19:15:07 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:07 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97 Sep 04 19:15:07 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:07 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975" returned: 0 in 0.254s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Lock "cinder-quobyte-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975" released by "delete_volume" :: held 0.677s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Created reservations ['072aa37a-72cb-4f25-b8ac-d1fa145a48f0', '5f92657f-254c-4395-a402-b6bd31b8a131', '94386fea-4644-4f32-8e80-d9582497fc3a', '38027dba-d392-4c24-a05c-36f53985d1ab'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:15:07 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97" returned: 0 in 0.358s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:07 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97 Sep 04 19:15:07 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:07 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:15:07 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:07 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97" returned: 0 in 0.266s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:07 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Lock "cinder-quobyte-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97" released by "delete_volume" :: held 0.686s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Deleted volume successfully. Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c707f2b9-12db-4c4b-84d3-05717dede209 tempest-VolumesNegativeTest-1584702626 None] Lock "cinder-9e236489-2d2d-4dc5-9ea7-c8e9e6a78975-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Created reservations ['5fe2d4b4-69f5-4361-8f84-34fe79a9cf5f', '5afa77d0-b98f-40b4-8356-54c79e71081e', 'bea961cc-d9b4-4c71-97d0-74a63c29524e', 'e1f085f7-a6ca-4432-8a60-6d3b7a9fe1ed'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:07 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:15:07 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:08 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.274s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:08 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:15:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Deleted volume successfully. Sep 04 19:15:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-878bf7fa-e4ab-48a1-ae16-4f431323281c tempest-VolumesActionsTest-329184483 None] Lock "cinder-6b22be9e-a2fa-407b-bcc4-0f1de2ae5a97-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Flow 'volume_create_manager' (2a77c004-85ae-4b39-a7cb-fc1a2f7f4906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f9ba2a-cf5d-4e34-ac47-19ddb907b378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70f9ba2a-cf5d-4e34-ac47-19ddb907b378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-412873464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c445965-7ae7-4d07-b99b-f437fed24ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e81ad66aa14440bba3752f391ced205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:10Z,use_quota=True,user_id='118dac2280e84ed0bd77294d6916e1fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90697865-5b1d-4bba-8698-12dc8b299f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90697865-5b1d-4bba-8698-12dc8b299f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabd071f-af61-4ab6-90c1-65a79284f526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eabd071f-af61-4ab6-90c1-65a79284f526) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c445965-7ae7-4d07-b99b-f437fed24ea7', 'volume_name': 'volume-5c445965-7ae7-4d07-b99b-f437fed24ea7', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd444ec7-745f-4d7e-ba66-636acf7460da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd444ec7-745f-4d7e-ba66-636acf7460da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe7520d-2576-4f99-9548-9dfe343a26d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:10 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Volume 5c445965-7ae7-4d07-b99b-f437fed24ea7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c445965-7ae7-4d07-b99b-f437fed24ea7', 'volume_size': 1} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-412873464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c445965-7ae7-4d07-b99b-f437fed24ea7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2e81ad66aa14440bba3752f391ced205',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:10Z,use_quota=True,user_id='118dac2280e84ed0bd77294d6916e1fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Creating volume 5c445965-7ae7-4d07-b99b-f437fed24ea7 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:15:10 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:15:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:10 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 1073741824 Sep 04 19:15:10 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:11 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 1073741824" returned: 0 in 0.519s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:11 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 Sep 04 19:15:11 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:11 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7" returned: 0 in 0.262s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:15:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe7520d-2576-4f99-9548-9dfe343a26d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c445965-7ae7-4d07-b99b-f437fed24ea7', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f950d87-ae68-46bb-a1ca-a0ebb1f9d556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:11 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Volume volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 (5c445965-7ae7-4d07-b99b-f437fed24ea7): created successfully Sep 04 19:15:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f950d87-ae68-46bb-a1ca-a0ebb1f9d556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Flow 'volume_create_manager' (2a77c004-85ae-4b39-a7cb-fc1a2f7f4906) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:15:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-850513d5-a9d0-4b58-8a92-5a4b5c74e958 tempest-VolumesSnapshotListTestJSON-1884466453 None] Created volume successfully. Sep 04 19:15:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] Creating offline snapshot 135bfee1-e4a6-4a5f-bddd-cba9b6878348 of volume 5c445965-7ae7-4d07-b99b-f437fed24ea7 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:15:12 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7483b622-d993-4503-a662-4a66a2255a68]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:12 devstack sudo[99186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 Sep 04 19:15:12 devstack sudo[99186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:13 devstack sudo[99186]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7" returned: 0 in 0.378s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:13 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 1G Sep 04 19:15:13 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:13 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 1G" returned: 0 in 0.490s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:13 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 Sep 04 19:15:13 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:14 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348" returned: 0 in 0.365s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:14 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 is being set with open permissions: ugo+rw Sep 04 19:15:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:14 devstack sudo[99217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 Sep 04 19:15:14 devstack sudo[99217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-225f72ed-3d75-47e8-9a83-85341bb5b393 req-2328760a-41aa-4696-acde-3ee3b4b8972a tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:14 devstack sudo[99217]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348" returned: 0 in 0.300s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:14 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.info Sep 04 19:15:14 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:14 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.info" returned: 0 in 0.243s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:14 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.info is being set with open permissions: ugo+rw Sep 04 19:15:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:14 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.info Sep 04 19:15:14 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:14 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.info" returned: 0 in 0.245s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-225f72ed-3d75-47e8-9a83-85341bb5b393 req-2328760a-41aa-4696-acde-3ee3b4b8972a tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.768s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-225f72ed-3d75-47e8-9a83-85341bb5b393 req-2328760a-41aa-4696-acde-3ee3b4b8972a tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-43fe3080-ffbf-4611-aa4a-cd2c766da0dd tempest-VolumesSnapshotListTestJSON-1884466453 None] Create snapshot completed successfully Sep 04 19:15:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-225f72ed-3d75-47e8-9a83-85341bb5b393 req-2328760a-41aa-4696-acde-3ee3b4b8972a tempest-TestInstancesWithCinderVolumes-576046077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fa05b5df-949c-4b5e-b8d7-993e2bed2cb7', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:15:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-225f72ed-3d75-47e8-9a83-85341bb5b393 req-2328760a-41aa-4696-acde-3ee3b4b8972a tempest-TestInstancesWithCinderVolumes-576046077 None] attachment_update completed successfully. Sep 04 19:15:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0a1e45e7-8d4b-4d06-9a50-f905f507c453 tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0a1e45e7-8d4b-4d06-9a50-f905f507c453 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0a1e45e7-8d4b-4d06-9a50-f905f507c453 tempest-VolumesSnapshotListTestJSON-1884466453 None] Creating offline snapshot 9758d5f9-2223-47f0-89a5-12bbd61c8ccf of volume 5c445965-7ae7-4d07-b99b-f437fed24ea7 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:15:16 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeaf62d-cb77-446f-9508-c9b5f4df5e17]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a1e45e7-8d4b-4d06-9a50-f905f507c453 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:16 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 Sep 04 19:15:16 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:16 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a1e45e7-8d4b-4d06-9a50-f905f507c453 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348" returned: 0 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0a1e45e7-8d4b-4d06-9a50-f905f507c453 tempest-VolumesSnapshotListTestJSON-1884466453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c445965-7ae7-4d07-b99b-f437fed24ea7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:15:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a1e45e7-8d4b-4d06-9a50-f905f507c453 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:16 devstack sudo[99240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf 1G Sep 04 19:15:16 devstack sudo[99240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:17 devstack sudo[99240]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a1e45e7-8d4b-4d06-9a50-f905f507c453 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf 1G" returned: 0 in 0.550s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a1e45e7-8d4b-4d06-9a50-f905f507c453 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:17 devstack sudo[99251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf Sep 04 19:15:17 devstack sudo[99251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-6f287244-1473-4671-a8e5-670970105499 req-5dcb620a-2512-4178-ad19-306eeec78d41 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:17 devstack sudo[99251]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a1e45e7-8d4b-4d06-9a50-f905f507c453 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf" returned: 0 in 0.332s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:17 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-0a1e45e7-8d4b-4d06-9a50-f905f507c453 tempest-VolumesSnapshotListTestJSON-1884466453 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf is being set with open permissions: ugo+rw Sep 04 19:15:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a1e45e7-8d4b-4d06-9a50-f905f507c453 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:17 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf Sep 04 19:15:17 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:17 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0a1e45e7-8d4b-4d06-9a50-f905f507c453 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf" returned: 0 in 0.251s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0a1e45e7-8d4b-4d06-9a50-f905f507c453 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.624s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-6f287244-1473-4671-a8e5-670970105499 req-5dcb620a-2512-4178-ad19-306eeec78d41 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.360s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-6f287244-1473-4671-a8e5-670970105499 req-5dcb620a-2512-4178-ad19-306eeec78d41 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0a1e45e7-8d4b-4d06-9a50-f905f507c453 tempest-VolumesSnapshotListTestJSON-1884466453 None] Create snapshot completed successfully Sep 04 19:15:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-6f287244-1473-4671-a8e5-670970105499 req-5dcb620a-2512-4178-ad19-306eeec78d41 tempest-TestInstancesWithCinderVolumes-576046077 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'efb07c82-d0b5-4fd6-a27d-d0fa039aa804', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:15:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-6f287244-1473-4671-a8e5-670970105499 req-5dcb620a-2512-4178-ad19-306eeec78d41 tempest-TestInstancesWithCinderVolumes-576046077 None] attachment_update completed successfully. Sep 04 19:15:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e64632f9-cbc6-41ee-9f97-8df4ba944e00 tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e64632f9-cbc6-41ee-9f97-8df4ba944e00 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e64632f9-cbc6-41ee-9f97-8df4ba944e00 tempest-VolumesSnapshotListTestJSON-1884466453 None] Creating offline snapshot 749b820a-b758-405a-9c9b-17a423f2fb51 of volume 5c445965-7ae7-4d07-b99b-f437fed24ea7 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:15:18 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0f2def-fdb0-45ae-ba62-3273f62f1c67]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e64632f9-cbc6-41ee-9f97-8df4ba944e00 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:18 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf Sep 04 19:15:18 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:18 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e64632f9-cbc6-41ee-9f97-8df4ba944e00 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf" returned: 0 in 0.367s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e64632f9-cbc6-41ee-9f97-8df4ba944e00 tempest-VolumesSnapshotListTestJSON-1884466453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c445965-7ae7-4d07-b99b-f437fed24ea7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:15:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e64632f9-cbc6-41ee-9f97-8df4ba944e00 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:18 devstack sudo[99276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51 1G Sep 04 19:15:18 devstack sudo[99276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:19 devstack sudo[99276]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e64632f9-cbc6-41ee-9f97-8df4ba944e00 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51 1G" returned: 0 in 0.467s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e64632f9-cbc6-41ee-9f97-8df4ba944e00 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:19 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51 Sep 04 19:15:19 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:19 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e64632f9-cbc6-41ee-9f97-8df4ba944e00 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51" returned: 0 in 0.295s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:19 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-e64632f9-cbc6-41ee-9f97-8df4ba944e00 tempest-VolumesSnapshotListTestJSON-1884466453 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51 is being set with open permissions: ugo+rw Sep 04 19:15:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e64632f9-cbc6-41ee-9f97-8df4ba944e00 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:19 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51 Sep 04 19:15:19 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:19 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e64632f9-cbc6-41ee-9f97-8df4ba944e00 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51" returned: 0 in 0.248s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e64632f9-cbc6-41ee-9f97-8df4ba944e00 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.488s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e64632f9-cbc6-41ee-9f97-8df4ba944e00 tempest-VolumesSnapshotListTestJSON-1884466453 None] Create snapshot completed successfully Sep 04 19:15:20 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:15:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Flow 'volume_create_manager' (61955bd1-8054-41cc-be26-cb99f71b0ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:15:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248d7386-93b0-452f-98af-eded7b64f507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (248d7386-93b0-452f-98af-eded7b64f507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1942606855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f2b961-11cc-4911-b0a3-9a5718b7c7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f712d36c63f043098bae98bfe450b939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:21Z,use_quota=True,user_id='cb5bb4f937f145d291d80927546b9360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205ae23b-25bf-41d5-8983-af379664d0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (205ae23b-25bf-41d5-8983-af379664d0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a3d72a-9e1a-48b6-8c72-6600162f463b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:20 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72a3d72a-9e1a-48b6-8c72-6600162f463b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '38f2b961-11cc-4911-b0a3-9a5718b7c7a2', 'volume_name': 'volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2', 'volume_size': 1, 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd0ece6d722f24154ab955bf866d06cbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'created_at': datetime.datetime(2026, 9, 4, 16, 58, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 58, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e637b08c-391d-4edc-8402-9ba212deb71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e07e03-3cc5-4d61-9509-702e46bf9b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e07e03-3cc5-4d61-9509-702e46bf9b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b0ec69-5db4-48d1-9dae-d2f440769852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:21 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Volume 38f2b961-11cc-4911-b0a3-9a5718b7c7a2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2', 'volume_size': 1, 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd0ece6d722f24154ab955bf866d06cbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'created_at': datetime.datetime(2026, 9, 4, 16, 58, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 58, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e637b08c-391d-4edc-8402-9ba212deb71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Trying to clone 38f2b961-11cc-4911-b0a3-9a5718b7c7a2 from image e637b08c-391d-4edc-8402-9ba212deb71d at location (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "cinder-749b820a-b758-405a-9c9b-17a423f2fb51-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-749b820a-b758-405a-9c9b-17a423f2fb51-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "cinder-quobyte-5c445965-7ae7-4d07-b99b-f437fed24ea7" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-quobyte-5c445965-7ae7-4d07-b99b-f437fed24ea7" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "cinder-quobyte-749b820a-b758-405a-9c9b-17a423f2fb51" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-quobyte-749b820a-b758-405a-9c9b-17a423f2fb51" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Deleting offline snapshot 749b820a-b758-405a-9c9b-17a423f2fb51 of volume 5c445965-7ae7-4d07-b99b-f437fed24ea7 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] snapshot_file for this snap is: volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c469879f-b709-4f22-bd63-3d627a74cc53]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_om2lzqw4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 19:15:21 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Image download 20.69 MB at 20.69 MB/s Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fb487a-9474-45ff-b1a3-66bafdeb18d1]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_om2lzqw4devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:21 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51 Sep 04 19:15:21 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:21 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_om2lzqw4devstack@QuobyteHD Sep 04 19:15:21 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:21 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51" returned: 0 in 0.410s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c445965-7ae7-4d07-b99b-f437fed24ea7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:15:22 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_om2lzqw4devstack@QuobyteHD" returned: 0 in 0.338s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Temporary image e637b08c-391d-4edc-8402-9ba212deb71d is fetched for user cb5bb4f937f145d291d80927546b9360. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4f5817-efcc-4290-a99f-8cf19fd67569]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0999140-2fda-4857-a318-113f451f4dc8]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_om2lzqw4devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:22 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf Sep 04 19:15:22 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:22 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_om2lzqw4devstack@QuobyteHD Sep 04 19:15:22 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:22 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf" returned: 0 in 0.383s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c445965-7ae7-4d07-b99b-f437fed24ea7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:22 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_om2lzqw4devstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1942606855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38f2b961-11cc-4911-b0a3-9a5718b7c7a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f712d36c63f043098bae98bfe450b939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:21Z,use_quota=True,user_id='cb5bb4f937f145d291d80927546b9360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:15:22 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51 Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Creating volume 38f2b961-11cc-4911-b0a3-9a5718b7c7a2 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:22 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:15:22 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:22 devstack sudo[99340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2 1073741824 Sep 04 19:15:22 devstack sudo[99340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:22 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51" returned: 0 in 0.425s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:22 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51 Sep 04 19:15:22 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:22 devstack sudo[99340]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2 1073741824" returned: 0 in 0.456s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:22 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2 Sep 04 19:15:22 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:23 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.749b820a-b758-405a-9c9b-17a423f2fb51" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-quobyte-749b820a-b758-405a-9c9b-17a423f2fb51" released by "_delete_snapshot" :: held 1.583s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-quobyte-5c445965-7ae7-4d07-b99b-f437fed24ea7" released by "delete_snapshot" :: held 1.615s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Created reservations ['a385a663-8e1b-4e08-a817-a6aa469b575a', '5362290c-a276-4922-b929-f1932e5c47fd', 'b6226e31-a6c8-4dab-a892-0bdc13267760', '249fbfc5-8f88-4d88-924a-0c4ee549df60'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:15:23 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2" returned: 0 in 0.324s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Attempting download of e637b08c-391d-4edc-8402-9ba212deb71d ((None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}])) to volume 38f2b961-11cc-4911-b0a3-9a5718b7c7a2. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 19:15:23 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Delete snapshot completed successfully. Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8bc24360-a5b9-4b52-b781-87802b74facd tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-749b820a-b758-405a-9c9b-17a423f2fb51-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe4d150-6f1b-4f9d-b3bb-7c2612dd9b10]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_cl6zy40b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:23 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_cl6zy40b Sep 04 19:15:23 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "cinder-9758d5f9-2223-47f0-89a5-12bbd61c8ccf-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-9758d5f9-2223-47f0-89a5-12bbd61c8ccf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "cinder-quobyte-5c445965-7ae7-4d07-b99b-f437fed24ea7" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:23 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-e178152e-f061-488c-a6d2-ba172a7d0f3a req-6babe335-6281-4f59-9542-79de06794a4e tempest-TestInstancesWithCinderVolumes-576046077 None] Terminate volume connection completed successfully. Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-e178152e-f061-488c-a6d2-ba172a7d0f3a req-6babe335-6281-4f59-9542-79de06794a4e tempest-TestInstancesWithCinderVolumes-576046077 None] Deleting attachment fa05b5df-949c-4b5e-b8d7-993e2bed2cb7. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-quobyte-5c445965-7ae7-4d07-b99b-f437fed24ea7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "cinder-quobyte-9758d5f9-2223-47f0-89a5-12bbd61c8ccf" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-quobyte-9758d5f9-2223-47f0-89a5-12bbd61c8ccf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Deleting offline snapshot 9758d5f9-2223-47f0-89a5-12bbd61c8ccf of volume 5c445965-7ae7-4d07-b99b-f437fed24ea7 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] snapshot_file for this snap is: volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6781891e-682f-4e7e-894a-acc32a007c55]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:23 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_cl6zy40b" returned: 0 in 0.387s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_cl6zy40b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:23 devstack sudo[99368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf Sep 04 19:15:23 devstack sudo[99368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:23 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_cl6zy40b Sep 04 19:15:23 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:24 devstack sudo[99368]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf" returned: 0 in 0.384s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c445965-7ae7-4d07-b99b-f437fed24ea7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:15:24 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_cl6zy40b" returned: 1 in 0.357s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_cl6zy40b' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34ff01d-6b5f-4004-897f-7339e29c3b41]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_om2lzqw4devstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d085be8-000b-49f0-9149-4e2bb02fb433]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:24 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_om2lzqw4devstack@QuobyteHD Sep 04 19:15:24 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:24 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 Sep 04 19:15:24 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "cinder-d4aa87d4-dae5-4563-aeb8-2584f43d6f82-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "cinder-d4aa87d4-dae5-4563-aeb8-2584f43d6f82-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "cinder-quobyte-d4aa87d4-dae5-4563-aeb8-2584f43d6f82" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:24 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_om2lzqw4devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] e637b08c-391d-4edc-8402-9ba212deb71d was qcow2, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_om2lzqw4devstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "cinder-quobyte-d4aa87d4-dae5-4563-aeb8-2584f43d6f82" acquired by "delete_volume" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:24 devstack sudo[99391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_om2lzqw4devstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2 Sep 04 19:15:24 devstack sudo[99391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[adada09e-ad1b-4ef2-8c8c-8bcf2fe897b8]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:24 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348" returned: 0 in 0.421s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c445965-7ae7-4d07-b99b-f437fed24ea7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:24 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf Sep 04 19:15:24 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:24 devstack sudo[99394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82 Sep 04 19:15:24 devstack sudo[99394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:24 devstack sudo[99394]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82" returned: 0 in 0.391s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:24 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82 Sep 04 19:15:24 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:24 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf" returned: 0 in 0.426s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:25 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf Sep 04 19:15:25 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:25 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d4aa87d4-dae5-4563-aeb8-2584f43d6f82" returned: 0 in 0.318s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "cinder-quobyte-d4aa87d4-dae5-4563-aeb8-2584f43d6f82" released by "delete_volume" :: held 0.767s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:25 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.9758d5f9-2223-47f0-89a5-12bbd61c8ccf" returned: 0 in 0.291s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-quobyte-9758d5f9-2223-47f0-89a5-12bbd61c8ccf" released by "_delete_snapshot" :: held 1.638s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-quobyte-5c445965-7ae7-4d07-b99b-f437fed24ea7" released by "delete_snapshot" :: held 1.667s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:25 devstack cinder-volume[87560]: WARNING cinder.quota [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-987354533-26025470 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-987354533-26025470, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:15:25 devstack cinder-volume[87560]: WARNING cinder.quota [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-987354533-26025470 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-987354533-26025470, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Created reservations ['854f8e68-c823-41f6-8c49-59c67619f824', '4563324a-3236-445d-812a-bad6fa938343', '32e4b0a3-74f0-4adb-9fa6-243f5841fad0', '45243054-dc25-468d-98c2-983510cf1e9c'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Created reservations ['4cf78cd7-5ddb-4950-9651-e27aeb190a3b', '321e6abc-af13-4ff1-a8de-fe0c8f85fa55', 'adb38f32-7aeb-4ae6-90c3-96112d1eba57', '8b85f97b-ff4f-4e94-aa99-1ec1d36323a6'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Delete snapshot completed successfully. Sep 04 19:15:25 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:15:25 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-36d8b873-f9c3-4af4-a56e-f30aaa46d884 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-9758d5f9-2223-47f0-89a5-12bbd61c8ccf-delete_snapshot" released by "delete_snapshot" :: held 1.888s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:25 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.267s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:15:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Deleted volume successfully. Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-95adb9d4-83fa-44ce-b51c-146110147813 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "cinder-d4aa87d4-dae5-4563-aeb8-2584f43d6f82-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "cinder-135bfee1-e4a6-4a5f-bddd-cba9b6878348-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-135bfee1-e4a6-4a5f-bddd-cba9b6878348-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "cinder-quobyte-5c445965-7ae7-4d07-b99b-f437fed24ea7" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-quobyte-5c445965-7ae7-4d07-b99b-f437fed24ea7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "cinder-quobyte-135bfee1-e4a6-4a5f-bddd-cba9b6878348" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-quobyte-135bfee1-e4a6-4a5f-bddd-cba9b6878348" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Deleting offline snapshot 135bfee1-e4a6-4a5f-bddd-cba9b6878348 of volume 5c445965-7ae7-4d07-b99b-f437fed24ea7 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] snapshot_file for this snap is: volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[63502803-e81a-4438-9af0-bf9894d4281f]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:26 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 Sep 04 19:15:26 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:26 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348" returned: 0 in 0.403s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c445965-7ae7-4d07-b99b-f437fed24ea7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1e3c4f-8df9-497e-9e71-63731d3f4a78]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:26 devstack sudo[99391]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_om2lzqw4devstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2" returned: 0 in 1.875s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_om2lzqw4devstack@QuobyteHD, size 112.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:15:26 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Converted 112.00 MB image at 59.71 MB/s Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:26 devstack sudo[99424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2 1G Sep 04 19:15:26 devstack sudo[99424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:26 devstack sudo[99423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 Sep 04 19:15:26 devstack sudo[99423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:26 devstack sudo[99423]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7" returned: 0 in 0.388s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:26 devstack sudo[99424]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2 1G" returned: 0 in 0.366s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Downloaded image e637b08c-391d-4edc-8402-9ba212deb71d ((None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}])) to volume 38f2b961-11cc-4911-b0a3-9a5718b7c7a2 successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Temporary image e637b08c-391d-4edc-8402-9ba212deb71d for user cb5bb4f937f145d291d80927546b9360 is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Marking volume 38f2b961-11cc-4911-b0a3-9a5718b7c7a2 as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 19:15:26 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 Sep 04 19:15:26 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Copying metadata from image e637b08c-391d-4edc-8402-9ba212deb71d to 38f2b961-11cc-4911-b0a3-9a5718b7c7a2. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Creating volume glance metadata for volume 38f2b961-11cc-4911-b0a3-9a5718b7c7a2 backed by image e637b08c-391d-4edc-8402-9ba212deb71d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92b0ec69-5db4-48d1-9dae-d2f440769852) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2', 'volume_size': 1, 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd0ece6d722f24154ab955bf866d06cbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'created_at': datetime.datetime(2026, 9, 4, 16, 58, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 58, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e637b08c-391d-4edc-8402-9ba212deb71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0a78f8-67df-4e3b-a2ee-0911a47d407e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:26 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Volume volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2 (38f2b961-11cc-4911-b0a3-9a5718b7c7a2): created successfully Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0a78f8-67df-4e3b-a2ee-0911a47d407e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Flow 'volume_create_manager' (61955bd1-8054-41cc-be26-cb99f71b0ef6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:15:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-95884fc2-69f7-4b02-aee1-43b9b31bc0d6 tempest-VolumesImageMetadata-1014484437 None] Created volume successfully. Sep 04 19:15:27 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348" returned: 0 in 0.347s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:27 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348 Sep 04 19:15:27 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:27 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7.135bfee1-e4a6-4a5f-bddd-cba9b6878348" returned: 0 in 0.260s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-quobyte-135bfee1-e4a6-4a5f-bddd-cba9b6878348" released by "_delete_snapshot" :: held 1.508s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-quobyte-5c445965-7ae7-4d07-b99b-f437fed24ea7" released by "delete_snapshot" :: held 1.532s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:27 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Created reservations ['77b0b6c5-1c07-412c-ad27-90d885f2186e', '70cae7fb-1940-44f9-a02c-5b227de1ef3d', '22accefc-495a-4240-97bf-30b9f55f591c', 'a4f792ee-4e1b-4644-9042-18bd7247337b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:15:27 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Delete snapshot completed successfully. Sep 04 19:15:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-390462d2-a782-4304-90b8-ff4ff1f3e72c tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-135bfee1-e4a6-4a5f-bddd-cba9b6878348-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Acquiring lock "cinder-38f2b961-11cc-4911-b0a3-9a5718b7c7a2-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Lock "cinder-38f2b961-11cc-4911-b0a3-9a5718b7c7a2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Acquiring lock "cinder-quobyte-38f2b961-11cc-4911-b0a3-9a5718b7c7a2" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Lock "cinder-quobyte-38f2b961-11cc-4911-b0a3-9a5718b7c7a2" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5770d2-eb57-4e28-a9bd-857886165620]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:27 devstack sudo[99463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2 Sep 04 19:15:27 devstack sudo[99463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "cinder-5c445965-7ae7-4d07-b99b-f437fed24ea7-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-5c445965-7ae7-4d07-b99b-f437fed24ea7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "cinder-quobyte-5c445965-7ae7-4d07-b99b-f437fed24ea7" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-quobyte-5c445965-7ae7-4d07-b99b-f437fed24ea7" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:28 devstack sudo[99463]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2" returned: 0 in 0.420s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bce6c27-c792-4abc-8506-2dd6725d2f03]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:28 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2 Sep 04 19:15:28 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-fe0b2ac4-8f6b-48cf-bcfa-e5beb48ba798 req-3b965f83-31e9-41f2-8464-5db6d3620601 tempest-TestInstancesWithCinderVolumes-576046077 None] Terminate volume connection completed successfully. Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-fe0b2ac4-8f6b-48cf-bcfa-e5beb48ba798 req-3b965f83-31e9-41f2-8464-5db6d3620601 tempest-TestInstancesWithCinderVolumes-576046077 None] Deleting attachment efb07c82-d0b5-4fd6-a27d-d0fa039aa804. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:15:28 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 Sep 04 19:15:28 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:28 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-38f2b961-11cc-4911-b0a3-9a5718b7c7a2" returned: 0 in 0.279s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Lock "cinder-quobyte-38f2b961-11cc-4911-b0a3-9a5718b7c7a2" released by "delete_volume" :: held 0.744s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Created reservations ['705d1eac-7262-4b1e-b64d-9be43fcb65b1', 'caeddc26-b6fe-437b-aa75-7e054287331f', '0c7c9189-9a02-44f7-9491-b1c935e8619d', 'b2b3a26d-0cc2-4281-9bef-18619fd6c1b6'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:15:28 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7" returned: 0 in 0.393s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:28 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7 Sep 04 19:15:28 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:28 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:15:28 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:28 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-5c445965-7ae7-4d07-b99b-f437fed24ea7" returned: 0 in 0.248s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-quobyte-5c445965-7ae7-4d07-b99b-f437fed24ea7" released by "delete_volume" :: held 0.703s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:28 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.257s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:15:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Deleted volume successfully. Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2faa8a1d-8be1-4990-8eb6-21e3737b434f tempest-VolumesImageMetadata-1014484437 None] Lock "cinder-38f2b961-11cc-4911-b0a3-9a5718b7c7a2-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Created reservations ['6b40281a-e8cc-4c08-8a79-078263daae2b', 'ce7d5317-d0b6-4289-887f-8b3944faced7', '5a3cfe14-dd0e-462e-aa8a-98d86fdec02f', '6594697e-6510-4a00-9bd6-23c0ccb36d08'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:29 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:15:29 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "cinder-2bb081c1-9b01-4e78-b948-4bf57ccddf80-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "cinder-2bb081c1-9b01-4e78-b948-4bf57ccddf80-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "cinder-quobyte-2bb081c1-9b01-4e78-b948-4bf57ccddf80" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "cinder-quobyte-2bb081c1-9b01-4e78-b948-4bf57ccddf80" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:29 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d767f324-199d-4e78-af29-78f9b7f64cd8]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:29 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.418s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:29 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:15:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Deleted volume successfully. Sep 04 19:15:29 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80 Sep 04 19:15:29 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8c568cbd-fa52-4788-bdcb-6520d23a3ae5 tempest-VolumesSnapshotListTestJSON-1884466453 None] Lock "cinder-5c445965-7ae7-4d07-b99b-f437fed24ea7-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:29 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80" returned: 0 in 0.550s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:29 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80 Sep 04 19:15:29 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:30 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2bb081c1-9b01-4e78-b948-4bf57ccddf80" returned: 0 in 0.305s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "cinder-quobyte-2bb081c1-9b01-4e78-b948-4bf57ccddf80" released by "delete_volume" :: held 0.946s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:30 devstack cinder-volume[87560]: WARNING cinder.quota [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1818762491-125990829 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1818762491-125990829, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:15:30 devstack cinder-volume[87560]: WARNING cinder.quota [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1818762491-125990829 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1818762491-125990829, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:15:30 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Created reservations ['68ff3ec7-8513-4233-b4a5-551c57f53625', '786f63ed-5639-4290-97fd-e68ccf055966', 'dcb17a34-a3f7-499a-8eb3-1ca0a9ffaeca', '1af1b7a9-4ca3-4488-9989-319fd0d4ccf7'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:15:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:30 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:15:30 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:30 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.258s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:30 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:15:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Deleted volume successfully. Sep 04 19:15:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-12999769-f504-4ba2-834b-f544c8ebe693 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "cinder-2bb081c1-9b01-4e78-b948-4bf57ccddf80-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Flow 'volume_create_manager' (048d7475-97a6-454d-80c6-5554f7f7801a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286b7b8f-32ee-4bba-9a89-99326f43acf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (286b7b8f-32ee-4bba-9a89-99326f43acf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-450188788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab44151-2ce8-4105-9300-528c51ac168d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab481c553e474b609893586c690af256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:33Z,use_quota=True,user_id='9ac2883d12224019b68e73e92c0d75b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a81a23f-6b30-4053-b481-181ba8bdb8bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a81a23f-6b30-4053-b481-181ba8bdb8bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bcb06ae-e7d8-48b5-ae9d-de7c6af4edc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bcb06ae-e7d8-48b5-ae9d-de7c6af4edc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bab44151-2ce8-4105-9300-528c51ac168d', 'volume_name': 'volume-bab44151-2ce8-4105-9300-528c51ac168d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32edb60-d9e3-47bb-b987-c70b8c233c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e32edb60-d9e3-47bb-b987-c70b8c233c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46298864-b4c8-467d-9b7f-80a2da49475b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:33 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Volume bab44151-2ce8-4105-9300-528c51ac168d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bab44151-2ce8-4105-9300-528c51ac168d', 'volume_size': 1} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-450188788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bab44151-2ce8-4105-9300-528c51ac168d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab481c553e474b609893586c690af256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:33Z,use_quota=True,user_id='9ac2883d12224019b68e73e92c0d75b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Creating volume bab44151-2ce8-4105-9300-528c51ac168d {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:15:33 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:33 devstack sudo[99538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d 1073741824 Sep 04 19:15:33 devstack sudo[99538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:33 devstack sudo[99538]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d 1073741824" returned: 0 in 0.720s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:34 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d Sep 04 19:15:34 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:34 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d" returned: 0 in 0.322s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] <== create_volume: return (1115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:15:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46298864-b4c8-467d-9b7f-80a2da49475b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bab44151-2ce8-4105-9300-528c51ac168d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9edce0-344a-4141-ae25-0aff89575335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:34 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Volume volume-bab44151-2ce8-4105-9300-528c51ac168d (bab44151-2ce8-4105-9300-528c51ac168d): created successfully Sep 04 19:15:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df9edce0-344a-4141-ae25-0aff89575335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Flow 'volume_create_manager' (048d7475-97a6-454d-80c6-5554f7f7801a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:15:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4b647f1c-5916-4623-a371-fafbb5f40e46 tempest-SnapshotMetadataTestJSON-867428915 None] Created volume successfully. Sep 04 19:15:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-8ba7ce5f-9b0f-44e3-b323-5c48c8bb1e9e req-456abd7c-8e7f-4fa1-8c71-e745ca9f73df tempest-TestInstancesWithCinderVolumes-576046077 None] Terminate volume connection completed successfully. Sep 04 19:15:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-8ba7ce5f-9b0f-44e3-b323-5c48c8bb1e9e req-456abd7c-8e7f-4fa1-8c71-e745ca9f73df tempest-TestInstancesWithCinderVolumes-576046077 None] Deleting attachment bab96f98-277a-4f48-98e6-6a4a2af69132. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:15:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] Creating offline snapshot d402d07c-d8db-4e3a-bf93-910a06d442a0 of volume bab44151-2ce8-4105-9300-528c51ac168d {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:15:35 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8e75fd-1872-430d-b78a-1a10f0b08ea2]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:35 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d Sep 04 19:15:35 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:35 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d" returned: 0 in 0.427s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:35 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0 1G Sep 04 19:15:35 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "cinder-c0eb44d4-bb91-4b95-b3da-ce8fcc781177-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "cinder-c0eb44d4-bb91-4b95-b3da-ce8fcc781177-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "cinder-quobyte-c0eb44d4-bb91-4b95-b3da-ce8fcc781177" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "cinder-quobyte-c0eb44d4-bb91-4b95-b3da-ce8fcc781177" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:36 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4132fc43-f3e4-4395-b508-8d37fd928c37]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:36 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0 1G" returned: 0 in 0.522s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab44151-2ce8-4105-9300-528c51ac168d -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:36 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab44151-2ce8-4105-9300-528c51ac168d -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0 Sep 04 19:15:36 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:36 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177 Sep 04 19:15:36 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:36 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bab44151-2ce8-4105-9300-528c51ac168d -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0" returned: 0 in 0.310s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:36 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0 is being set with open permissions: ugo+rw Sep 04 19:15:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:36 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0 Sep 04 19:15:36 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:36 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177" returned: 0 in 0.462s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:36 devstack sudo[99595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177 Sep 04 19:15:36 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:36 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0" returned: 0 in 0.291s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:37 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.info Sep 04 19:15:37 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:37 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0eb44d4-bb91-4b95-b3da-ce8fcc781177" returned: 0 in 0.290s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "cinder-quobyte-c0eb44d4-bb91-4b95-b3da-ce8fcc781177" released by "delete_volume" :: held 0.816s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:37 devstack cinder-volume[87560]: WARNING cinder.quota [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-892692225-516553248 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-892692225-516553248, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:15:37 devstack cinder-volume[87560]: WARNING cinder.quota [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-892692225-516553248 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-892692225-516553248, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Created reservations ['f798f932-fa53-4e27-931b-dc2a87bae3cd', 'a9354194-94d2-4d8d-b625-18aaa68c9331', 'a7d833a2-fa36-4747-8103-b0f5bfa53f55', '6924c7ec-0168-4ec4-94e3-bf7c338a2107'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:37 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:15:37 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:37 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.info" returned: 0 in 0.328s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:37 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.info is being set with open permissions: ugo+rw Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:37 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.info Sep 04 19:15:37 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:37 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.332s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:15:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Deleted volume successfully. Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2a877ad1-2b38-49b9-8778-0673b1f80901 tempest-TestInstancesWithCinderVolumes-576046077 None] Lock "cinder-c0eb44d4-bb91-4b95-b3da-ce8fcc781177-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:37 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.info" returned: 0 in 0.365s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-399c767c-13ac-40fb-b3ef-f813d921ec38 tempest-SnapshotMetadataTestJSON-867428915 None] Create snapshot completed successfully Sep 04 19:15:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Acquiring lock "cinder-d402d07c-d8db-4e3a-bf93-910a06d442a0-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "cinder-d402d07c-d8db-4e3a-bf93-910a06d442a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Acquiring lock "cinder-quobyte-bab44151-2ce8-4105-9300-528c51ac168d" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "cinder-quobyte-bab44151-2ce8-4105-9300-528c51ac168d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Acquiring lock "cinder-quobyte-d402d07c-d8db-4e3a-bf93-910a06d442a0" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "cinder-quobyte-d402d07c-d8db-4e3a-bf93-910a06d442a0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Deleting offline snapshot d402d07c-d8db-4e3a-bf93-910a06d442a0 of volume bab44151-2ce8-4105-9300-528c51ac168d {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:15:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] snapshot_file for this snap is: volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:15:39 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49cd3f3-4a83-4e79-8bbe-a6ac1d5bb3e8]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:39 devstack sudo[99609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0 Sep 04 19:15:39 devstack sudo[99609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:40 devstack sudo[99609]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0" returned: 0 in 0.462s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bab44151-2ce8-4105-9300-528c51ac168d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:15:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d2bae0-ac83-498f-8d10-96b7213de916]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:40 devstack sudo[99616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d Sep 04 19:15:40 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:40 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d" returned: 0 in 0.506s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:40 devstack sudo[99621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0 Sep 04 19:15:40 devstack sudo[99621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:41 devstack sudo[99621]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0" returned: 0 in 0.430s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:41 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0 Sep 04 19:15:41 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:41 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d.d402d07c-d8db-4e3a-bf93-910a06d442a0" returned: 0 in 0.287s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "cinder-quobyte-d402d07c-d8db-4e3a-bf93-910a06d442a0" released by "_delete_snapshot" :: held 1.817s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "cinder-quobyte-bab44151-2ce8-4105-9300-528c51ac168d" released by "delete_snapshot" :: held 1.846s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:41 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Created reservations ['a3569f40-4922-4f37-9290-47aa56c1cbc4', '08c793db-6482-40dd-b86f-7bdf916e2eba', '22b8cfb0-09e7-4d09-ac97-b63a325f7850', '3e371488-b79b-458e-8d53-4d8a63826a98'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:15:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Delete snapshot completed successfully. Sep 04 19:15:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2f355e6e-e7c8-483f-9814-07f2f1dab307 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "cinder-d402d07c-d8db-4e3a-bf93-910a06d442a0-delete_snapshot" released by "delete_snapshot" :: held 2.152s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Acquiring lock "cinder-bab44151-2ce8-4105-9300-528c51ac168d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "cinder-bab44151-2ce8-4105-9300-528c51ac168d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Acquiring lock "cinder-quobyte-bab44151-2ce8-4105-9300-528c51ac168d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:15:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "cinder-quobyte-bab44151-2ce8-4105-9300-528c51ac168d" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:15:41 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ace4d8-d42c-4489-b1ab-d9e8c86479c5]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:15:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:42 devstack sudo[99630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d Sep 04 19:15:42 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:42 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d" returned: 0 in 0.455s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:42 devstack sudo[99636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d Sep 04 19:15:42 devstack sudo[99636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:42 devstack sudo[99636]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-bab44151-2ce8-4105-9300-528c51ac168d" returned: 0 in 0.375s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "cinder-quobyte-bab44151-2ce8-4105-9300-528c51ac168d" released by "delete_volume" :: held 0.939s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:42 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Created reservations ['0111f196-0f32-4e10-96c6-6c13f59e81b4', 'f984037a-1564-47db-bedb-2b95bfeed262', '281ef7af-1afa-4d52-80c0-26eaa87f1cda', '58f96f67-478a-4be8-967f-c944098399dc'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:15:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:43 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:15:43 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:43 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.431s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:43 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:15:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Deleted volume successfully. Sep 04 19:15:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d5c60766-7192-4f9e-910c-82506187ddd1 tempest-SnapshotMetadataTestJSON-867428915 None] Lock "cinder-bab44151-2ce8-4105-9300-528c51ac168d-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:15:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:15:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:45 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:15:45 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:45 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.309s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:15:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:15:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:15:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:15:53 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=107,cinder:UPDATE=108,cinder:INSERT=39,cinder:DELETE=7 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:15:53 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=106,cinder:DELETE=9,cinder:SELECT=99,cinder:INSERT=28 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Flow 'volume_create_manager' (f3c3849f-365d-45df-a70e-1c2f0f80bd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548e30e1-fc8f-4d3d-bfb7-66f11f5b89d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548e30e1-fc8f-4d3d-bfb7-66f11f5b89d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-88432609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f83bc65-1ab7-4990-98a2-9aba534bb158,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc1ec1265a8a4e088dd8e503b1f6fe28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:54Z,use_quota=True,user_id='722547f8f5404a918c92346291ce3530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3896ebca-5881-4f2c-8aed-57d312c4fe4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3896ebca-5881-4f2c-8aed-57d312c4fe4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358c184c-61d6-4864-84c3-2cd94eff7bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358c184c-61d6-4864-84c3-2cd94eff7bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f83bc65-1ab7-4990-98a2-9aba534bb158', 'volume_name': 'volume-0f83bc65-1ab7-4990-98a2-9aba534bb158', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd17e59-9e25-4c16-8e2a-b32ce6ad1c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd17e59-9e25-4c16-8e2a-b32ce6ad1c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ec5e26-47a0-4872-bbe3-e545be237c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:54 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Volume 0f83bc65-1ab7-4990-98a2-9aba534bb158: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f83bc65-1ab7-4990-98a2-9aba534bb158', 'volume_size': 1} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-88432609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f83bc65-1ab7-4990-98a2-9aba534bb158,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc1ec1265a8a4e088dd8e503b1f6fe28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:54Z,use_quota=True,user_id='722547f8f5404a918c92346291ce3530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Creating volume 0f83bc65-1ab7-4990-98a2-9aba534bb158 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:15:54 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0f83bc65-1ab7-4990-98a2-9aba534bb158 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:54 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0f83bc65-1ab7-4990-98a2-9aba534bb158 1073741824 Sep 04 19:15:54 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:54 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0f83bc65-1ab7-4990-98a2-9aba534bb158 1073741824" returned: 0 in 0.529s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0f83bc65-1ab7-4990-98a2-9aba534bb158 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:54 devstack sudo[99663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0f83bc65-1ab7-4990-98a2-9aba534bb158 Sep 04 19:15:54 devstack sudo[99663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:55 devstack sudo[99663]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0f83bc65-1ab7-4990-98a2-9aba534bb158" returned: 0 in 0.296s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:15:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ec5e26-47a0-4872-bbe3-e545be237c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f83bc65-1ab7-4990-98a2-9aba534bb158', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94848fa1-4820-49dd-9d7d-9e501053f9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:55 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Volume volume-0f83bc65-1ab7-4990-98a2-9aba534bb158 (0f83bc65-1ab7-4990-98a2-9aba534bb158): created successfully Sep 04 19:15:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94848fa1-4820-49dd-9d7d-9e501053f9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Flow 'volume_create_manager' (f3c3849f-365d-45df-a70e-1c2f0f80bd73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:15:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-af177bcc-e713-4446-ac57-40d718e47e2d tempest-VolumesListTestJSON-1807658126 None] Created volume successfully. Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Flow 'volume_create_manager' (34d7474a-ca94-422a-94ef-d9362cc1459d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe38f188-bfae-4e28-a61f-e18f2b55e715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe38f188-bfae-4e28-a61f-e18f2b55e715) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1712623499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8c5cfb-f437-4dc9-a8bc-88a14646d110,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc1ec1265a8a4e088dd8e503b1f6fe28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:57Z,use_quota=True,user_id='722547f8f5404a918c92346291ce3530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3e72cd-4aa5-423c-8aef-228eccf0f6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd3e72cd-4aa5-423c-8aef-228eccf0f6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49bfacd-5fd0-46df-b37c-b0e0dba5134a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49bfacd-5fd0-46df-b37c-b0e0dba5134a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b8c5cfb-f437-4dc9-a8bc-88a14646d110', 'volume_name': 'volume-3b8c5cfb-f437-4dc9-a8bc-88a14646d110', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bebb7c3c-780e-492b-bdcf-b02e82ef700f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bebb7c3c-780e-492b-bdcf-b02e82ef700f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5d3cca-8a03-41f6-88e0-c88c2dc20f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:57 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Volume 3b8c5cfb-f437-4dc9-a8bc-88a14646d110: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b8c5cfb-f437-4dc9-a8bc-88a14646d110', 'volume_size': 1} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1712623499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8c5cfb-f437-4dc9-a8bc-88a14646d110,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc1ec1265a8a4e088dd8e503b1f6fe28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:57Z,use_quota=True,user_id='722547f8f5404a918c92346291ce3530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Creating volume 3b8c5cfb-f437-4dc9-a8bc-88a14646d110 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:15:57 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3b8c5cfb-f437-4dc9-a8bc-88a14646d110 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:57 devstack sudo[99666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3b8c5cfb-f437-4dc9-a8bc-88a14646d110 1073741824 Sep 04 19:15:57 devstack sudo[99666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:57 devstack sudo[99666]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3b8c5cfb-f437-4dc9-a8bc-88a14646d110 1073741824" returned: 0 in 0.628s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3b8c5cfb-f437-4dc9-a8bc-88a14646d110 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:58 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3b8c5cfb-f437-4dc9-a8bc-88a14646d110 Sep 04 19:15:58 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:58 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3b8c5cfb-f437-4dc9-a8bc-88a14646d110" returned: 0 in 0.361s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a5d3cca-8a03-41f6-88e0-c88c2dc20f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b8c5cfb-f437-4dc9-a8bc-88a14646d110', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b8bbbd7-5cc2-4e9c-82b3-1353d50bd769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:58 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Volume volume-3b8c5cfb-f437-4dc9-a8bc-88a14646d110 (3b8c5cfb-f437-4dc9-a8bc-88a14646d110): created successfully Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b8bbbd7-5cc2-4e9c-82b3-1353d50bd769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Flow 'volume_create_manager' (34d7474a-ca94-422a-94ef-d9362cc1459d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:15:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ab02d35d-75e4-4991-b58f-5d23887a09f5 tempest-VolumesListTestJSON-1807658126 None] Created volume successfully. Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Flow 'volume_create_manager' (2285f9af-1152-4e66-8027-407d054c3134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bafa7a4-9641-4c30-9c4a-b26646f63513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bafa7a4-9641-4c30-9c4a-b26646f63513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1459138861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cba3a01-8fc2-46ae-a94d-a715913b53cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d2122948e7426bb1a93ffab79251a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:59Z,use_quota=True,user_id='c598961b6f744eaf91bcd8384712c68f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb07ba6-70c2-4411-8d9e-2a5a51fe68ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb07ba6-70c2-4411-8d9e-2a5a51fe68ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd89a1f1-54bc-4b76-8a28-01d6c2664a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd89a1f1-54bc-4b76-8a28-01d6c2664a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cba3a01-8fc2-46ae-a94d-a715913b53cb', 'volume_name': 'volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5d447f-7b5a-4c91-91b0-89c1d4632d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5d447f-7b5a-4c91-91b0-89c1d4632d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5023955-508a-48c1-925f-17b32aa6eb37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:58 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Volume 3cba3a01-8fc2-46ae-a94d-a715913b53cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb', 'volume_size': 1} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1459138861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cba3a01-8fc2-46ae-a94d-a715913b53cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d2122948e7426bb1a93ffab79251a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:59Z,use_quota=True,user_id='c598961b6f744eaf91bcd8384712c68f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Creating volume 3cba3a01-8fc2-46ae-a94d-a715913b53cb {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:15:58 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:15:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:58 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb 1073741824 Sep 04 19:15:58 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:15:59 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:15:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Flow 'volume_create_manager' (19d0f258-3d7d-41cf-9344-c304503a34bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:15:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6fdeca-3124-4168-853b-3deb72134a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6fdeca-3124-4168-853b-3deb72134a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-491376500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f73295-4c00-45f4-a067-eb8c1addd727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d2122948e7426bb1a93ffab79251a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:59Z,use_quota=True,user_id='c598961b6f744eaf91bcd8384712c68f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fefd31-cc70-458b-b0d6-e75b05f0f6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fefd31-cc70-458b-b0d6-e75b05f0f6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a22be58-5527-4da4-b9c7-fd076c2af2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a22be58-5527-4da4-b9c7-fd076c2af2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6f73295-4c00-45f4-a067-eb8c1addd727', 'volume_name': 'volume-d6f73295-4c00-45f4-a067-eb8c1addd727', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc6405c-b639-4ffa-bc33-b30ef4cacdfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc6405c-b639-4ffa-bc33-b30ef4cacdfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:15:59 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1799cfe0-5377-4941-8123-8152a05ab050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:15:59 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Volume d6f73295-4c00-45f4-a067-eb8c1addd727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6f73295-4c00-45f4-a067-eb8c1addd727', 'volume_size': 1} Sep 04 19:15:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:15:59 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Sep 04 19:15:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb 1073741824" returned: 0 in 0.687s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:15:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:15:59 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb Sep 04 19:15:59 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:00 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb" returned: 0 in 0.433s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.603s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-491376500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6f73295-4c00-45f4-a067-eb8c1addd727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8d2122948e7426bb1a93ffab79251a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:15:59Z,use_quota=True,user_id='c598961b6f744eaf91bcd8384712c68f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Creating volume d6f73295-4c00-45f4-a067-eb8c1addd727 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:16:00 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d6f73295-4c00-45f4-a067-eb8c1addd727 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5023955-508a-48c1-925f-17b32aa6eb37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:00 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d6f73295-4c00-45f4-a067-eb8c1addd727 1073741824 Sep 04 19:16:00 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c7a2a0-3cf5-4547-a64f-4adf746c1046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:00 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Volume volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb (3cba3a01-8fc2-46ae-a94d-a715913b53cb): created successfully Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46c7a2a0-3cf5-4547-a64f-4adf746c1046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Flow 'volume_create_manager' (2285f9af-1152-4e66-8027-407d054c3134) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:16:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4e60d75c-91ba-4707-aab7-e22eff73a02f tempest-TestServerVolumeAttachmentScenario-1469587397 None] Created volume successfully. Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Flow 'volume_create_manager' (eda6f123-44d3-499e-ae43-209fd8a71841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bdf5e7-a109-40d5-af2b-191c5fbeb6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17bdf5e7-a109-40d5-af2b-191c5fbeb6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1507448279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c250162-52a3-4ff6-b752-5272162f6689,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc1ec1265a8a4e088dd8e503b1f6fe28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:16:00Z,use_quota=True,user_id='722547f8f5404a918c92346291ce3530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab71a4c-bad6-4ec8-9b7d-f053ce6463b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab71a4c-bad6-4ec8-9b7d-f053ce6463b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22689fd-125b-4c2d-a2ad-d63fda27ae4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c22689fd-125b-4c2d-a2ad-d63fda27ae4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c250162-52a3-4ff6-b752-5272162f6689', 'volume_name': 'volume-7c250162-52a3-4ff6-b752-5272162f6689', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e3534a-ebbb-464f-b2ff-44cfeb2ecb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98e3534a-ebbb-464f-b2ff-44cfeb2ecb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21fec35a-2765-4692-8f33-5492f7bd98ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:00 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Volume 7c250162-52a3-4ff6-b752-5272162f6689: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c250162-52a3-4ff6-b752-5272162f6689', 'volume_size': 1} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:00 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d6f73295-4c00-45f4-a067-eb8c1addd727 1073741824" returned: 0 in 0.591s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d6f73295-4c00-45f4-a067-eb8c1addd727 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:00 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d6f73295-4c00-45f4-a067-eb8c1addd727 Sep 04 19:16:00 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:00 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d6f73295-4c00-45f4-a067-eb8c1addd727" returned: 0 in 0.272s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.645s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:16:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1507448279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c250162-52a3-4ff6-b752-5272162f6689,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bc1ec1265a8a4e088dd8e503b1f6fe28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:16:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:16:00Z,use_quota=True,user_id='722547f8f5404a918c92346291ce3530',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Creating volume 7c250162-52a3-4ff6-b752-5272162f6689 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:16:00 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:16:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7c250162-52a3-4ff6-b752-5272162f6689 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1799cfe0-5377-4941-8123-8152a05ab050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6f73295-4c00-45f4-a067-eb8c1addd727', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:01 devstack sudo[99694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7c250162-52a3-4ff6-b752-5272162f6689 1073741824 Sep 04 19:16:01 devstack sudo[99694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6963bc-d03c-41a7-a499-9adff171cce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:01 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Volume volume-d6f73295-4c00-45f4-a067-eb8c1addd727 (d6f73295-4c00-45f4-a067-eb8c1addd727): created successfully Sep 04 19:16:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a6963bc-d03c-41a7-a499-9adff171cce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Flow 'volume_create_manager' (19d0f258-3d7d-41cf-9344-c304503a34bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:16:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-23bcde51-0a43-4db8-aa1c-a3d335697ac2 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Created volume successfully. Sep 04 19:16:01 devstack sudo[99694]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7c250162-52a3-4ff6-b752-5272162f6689 1073741824" returned: 0 in 0.652s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7c250162-52a3-4ff6-b752-5272162f6689 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:01 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7c250162-52a3-4ff6-b752-5272162f6689 Sep 04 19:16:01 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:01 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7c250162-52a3-4ff6-b752-5272162f6689" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:16:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21fec35a-2765-4692-8f33-5492f7bd98ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c250162-52a3-4ff6-b752-5272162f6689', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb8851e-f1ee-402c-9270-ad7a3878163e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:01 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Volume volume-7c250162-52a3-4ff6-b752-5272162f6689 (7c250162-52a3-4ff6-b752-5272162f6689): created successfully Sep 04 19:16:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bb8851e-f1ee-402c-9270-ad7a3878163e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Flow 'volume_create_manager' (eda6f123-44d3-499e-ae43-209fd8a71841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:16:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b2177d2d-f7cb-4abd-95d2-3fc7f6f3b127 tempest-VolumesListTestJSON-1807658126 None] Created volume successfully. Sep 04 19:16:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Acquiring lock "cinder-7c250162-52a3-4ff6-b752-5272162f6689-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Lock "cinder-7c250162-52a3-4ff6-b752-5272162f6689-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Acquiring lock "cinder-quobyte-7c250162-52a3-4ff6-b752-5272162f6689" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Lock "cinder-quobyte-7c250162-52a3-4ff6-b752-5272162f6689" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:05 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[566fef34-2d49-4d6f-881d-b30794241ca1]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:16:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7c250162-52a3-4ff6-b752-5272162f6689 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:05 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7c250162-52a3-4ff6-b752-5272162f6689 Sep 04 19:16:05 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:05 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7c250162-52a3-4ff6-b752-5272162f6689" returned: 0 in 0.516s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7c250162-52a3-4ff6-b752-5272162f6689 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:05 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7c250162-52a3-4ff6-b752-5272162f6689 Sep 04 19:16:05 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:05 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7c250162-52a3-4ff6-b752-5272162f6689" returned: 0 in 0.303s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Lock "cinder-quobyte-7c250162-52a3-4ff6-b752-5272162f6689" released by "delete_volume" :: held 0.876s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:05 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Created reservations ['d0899e2a-b07a-408d-8899-1648926cf0a5', 'e584da7c-d502-417b-aa93-2f75c4c653b4', '17f73141-e5e5-4bd3-b260-d3529362cd88', '4c9ada2a-2e66-4340-a5df-f189e6d92c87'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:06 devstack sudo[99732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:16:06 devstack sudo[99732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Acquiring lock "cinder-3b8c5cfb-f437-4dc9-a8bc-88a14646d110-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Lock "cinder-3b8c5cfb-f437-4dc9-a8bc-88a14646d110-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Acquiring lock "cinder-quobyte-3b8c5cfb-f437-4dc9-a8bc-88a14646d110" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Lock "cinder-quobyte-3b8c5cfb-f437-4dc9-a8bc-88a14646d110" acquired by "delete_volume" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:06 devstack sudo[99732]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.361s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:16:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Deleted volume successfully. Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab3e47f-9122-4460-a026-a8dc20964c53]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3b8c5cfb-f437-4dc9-a8bc-88a14646d110 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b88ae18c-db8e-40a1-85b4-8fa7dd4ad3be tempest-VolumesListTestJSON-1807658126 None] Lock "cinder-7c250162-52a3-4ff6-b752-5272162f6689-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:06 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3b8c5cfb-f437-4dc9-a8bc-88a14646d110 Sep 04 19:16:06 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:06 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3b8c5cfb-f437-4dc9-a8bc-88a14646d110" returned: 0 in 0.468s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3b8c5cfb-f437-4dc9-a8bc-88a14646d110 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:06 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3b8c5cfb-f437-4dc9-a8bc-88a14646d110 Sep 04 19:16:06 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:07 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3b8c5cfb-f437-4dc9-a8bc-88a14646d110" returned: 0 in 0.304s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Lock "cinder-quobyte-3b8c5cfb-f437-4dc9-a8bc-88a14646d110" released by "delete_volume" :: held 0.828s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:07 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Created reservations ['02b62b0d-4ded-401b-83a5-a97f13b0920b', 'eaabb48a-8dbb-4869-a763-2b267fe01ce0', '4d90bbb7-9e09-4989-8cba-dae860a7433a', '9ad7e615-4af6-472d-adcd-1abc5688f4ba'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:16:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:16:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:16:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:07 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:16:07 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Acquiring lock "cinder-0f83bc65-1ab7-4990-98a2-9aba534bb158-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Lock "cinder-0f83bc65-1ab7-4990-98a2-9aba534bb158-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:07 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.504s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:07 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:16:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Acquiring lock "cinder-quobyte-0f83bc65-1ab7-4990-98a2-9aba534bb158" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Deleted volume successfully. Sep 04 19:16:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Lock "cinder-quobyte-0f83bc65-1ab7-4990-98a2-9aba534bb158" acquired by "delete_volume" :: waited 0.044s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ee5a9c70-ba8d-4b1c-8c90-f7925bd95e53 tempest-VolumesListTestJSON-1807658126 None] Lock "cinder-3b8c5cfb-f437-4dc9-a8bc-88a14646d110-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:08 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28f61f1-71ec-4e55-97a8-40a28c49f8e1]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:16:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0f83bc65-1ab7-4990-98a2-9aba534bb158 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:08 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0f83bc65-1ab7-4990-98a2-9aba534bb158 Sep 04 19:16:08 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:08 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0f83bc65-1ab7-4990-98a2-9aba534bb158" returned: 0 in 0.645s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0f83bc65-1ab7-4990-98a2-9aba534bb158 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:08 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0f83bc65-1ab7-4990-98a2-9aba534bb158 Sep 04 19:16:08 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:08 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0f83bc65-1ab7-4990-98a2-9aba534bb158" returned: 0 in 0.304s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Lock "cinder-quobyte-0f83bc65-1ab7-4990-98a2-9aba534bb158" released by "delete_volume" :: held 1.045s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:09 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Created reservations ['e69cc237-f48c-4003-b408-6629b83eb003', 'e48fd4b8-ec59-4afd-81d1-12d769792c3c', '8f2fd4cd-f855-4464-89f5-802b0744728e', '5c84bd30-6a9e-40d2-ba6f-289113050745'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:16:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:16:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:16:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:09 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:16:09 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:09 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.539s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:16:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Deleted volume successfully. Sep 04 19:16:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ea7752be-bc5a-4584-833f-29b61008e8d0 tempest-VolumesListTestJSON-1807658126 None] Lock "cinder-0f83bc65-1ab7-4990-98a2-9aba534bb158-delete_volume" released by "delete_volume" :: held 2.004s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:19 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=27,cinder:UPDATE=42,cinder:DELETE=3,cinder:INSERT=7 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:16:19 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=36,cinder:SELECT=23,cinder:INSERT=10,cinder:DELETE=5 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Flow 'volume_create_manager' (374bedb4-be89-4d03-9c5b-e1033df822e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec34e37-d8a9-4f19-8ab6-d89627ac307a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ec34e37-d8a9-4f19-8ab6-d89627ac307a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2035261988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63033f8e386497c8402a97ec3e48783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:16:24Z,use_quota=True,user_id='cdfb96de2d4b431781de239550500f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56d6d89-d838-4d89-a9df-1ba0f5bfa0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b56d6d89-d838-4d89-a9df-1ba0f5bfa0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36bdcef0-4666-4ce3-93e6-1d9493df81ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36bdcef0-4666-4ce3-93e6-1d9493df81ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420', 'volume_name': 'volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3ba1b6-7b0d-401a-b2fd-0628eb025e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c3ba1b6-7b0d-401a-b2fd-0628eb025e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5532a82-6e5b-4479-a9e4-7244d9228d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Volume 1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420', 'volume_size': 1} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:16:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2035261988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63033f8e386497c8402a97ec3e48783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:16:24Z,use_quota=True,user_id='cdfb96de2d4b431781de239550500f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Creating volume 1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:16:24 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:24 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 1073741824 Sep 04 19:16:24 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:24 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 1073741824" returned: 0 in 0.474s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:24 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 Sep 04 19:16:24 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:25 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:16:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5532a82-6e5b-4479-a9e4-7244d9228d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc3d5c1-1762-4046-9c2e-ee7325422379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:25 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Volume volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 (1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420): created successfully Sep 04 19:16:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acc3d5c1-1762-4046-9c2e-ee7325422379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Flow 'volume_create_manager' (374bedb4-be89-4d03-9c5b-e1033df822e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:16:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-680eccf8-893b-4ac5-93c4-bdd8382d51da tempest-VolumesSnapshotTestJSON-663916029 None] Created volume successfully. Sep 04 19:16:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] Creating offline snapshot 5d13d99a-f99c-4c9f-a38d-875bcb38736f of volume 1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:16:26 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e8f55a-4414-4af3-8074-ef1cfd7d6900]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:16:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:26 devstack sudo[99876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 Sep 04 19:16:26 devstack sudo[99876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:27 devstack sudo[99876]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420" returned: 0 in 0.445s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:27 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f 1G Sep 04 19:16:27 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:27 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f 1G" returned: 0 in 0.671s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:27 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f Sep 04 19:16:27 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:28 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f" returned: 0 in 0.456s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:28 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f is being set with open permissions: ugo+rw Sep 04 19:16:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:28 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f Sep 04 19:16:28 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:28 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f" returned: 0 in 0.395s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:28 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.info Sep 04 19:16:28 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:29 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.info" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:29 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.info is being set with open permissions: ugo+rw Sep 04 19:16:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:29 devstack sudo[99898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.info Sep 04 19:16:29 devstack sudo[99898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:29 devstack sudo[99898]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.info" returned: 0 in 0.277s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.665s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-700c0704-daf7-4cf7-9312-7f1687a55846 tempest-VolumesSnapshotTestJSON-663916029 None] Create snapshot completed successfully Sep 04 19:16:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-5d13d99a-f99c-4c9f-a38d-875bcb38736f-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-5d13d99a-f99c-4c9f-a38d-875bcb38736f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-quobyte-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-quobyte-5d13d99a-f99c-4c9f-a38d-875bcb38736f" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-5d13d99a-f99c-4c9f-a38d-875bcb38736f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Deleting offline snapshot 5d13d99a-f99c-4c9f-a38d-875bcb38736f of volume 1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:16:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] snapshot_file for this snap is: volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:16:30 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3138bff2-4b57-4d3b-a70a-0e7cfd0a34a3]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:16:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:30 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f Sep 04 19:16:30 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:30 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f" returned: 0 in 0.385s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:16:30 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[524c2e8e-2161-4c19-9acd-3f50387067a2]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:16:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:30 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 Sep 04 19:16:30 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:31 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420" returned: 0 in 0.383s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:31 devstack sudo[99947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f Sep 04 19:16:31 devstack sudo[99947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:31 devstack sudo[99947]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f" returned: 0 in 0.369s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:31 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f Sep 04 19:16:31 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:31 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420.5d13d99a-f99c-4c9f-a38d-875bcb38736f" returned: 0 in 0.267s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-5d13d99a-f99c-4c9f-a38d-875bcb38736f" released by "_delete_snapshot" :: held 1.519s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420" released by "delete_snapshot" :: held 1.541s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:31 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Created reservations ['badeef4e-c450-4261-8475-f1efc156e6b3', '4988595c-88b1-44ed-88c8-0fd2e0f56685', '7c9c7914-6cfd-483d-ab5f-061db6cac469', '6ee340c1-1aee-4178-91a2-b53b680d3e12'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:16:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Delete snapshot completed successfully. Sep 04 19:16:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48d01069-2aee-4201-8512-9826d4f4e1d5 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-5d13d99a-f99c-4c9f-a38d-875bcb38736f-delete_snapshot" released by "delete_snapshot" :: held 1.730s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:32 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:16:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Flow 'volume_create_manager' (28cda461-b47e-434c-bd72-4a6e48d4485c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:16:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8b26b9-4f7a-4688-a8d1-6c8284b3dbb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d8b26b9-4f7a-4688-a8d1-6c8284b3dbb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-371012617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a5f7dc-2e20-4451-bc39-45293b370394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63033f8e386497c8402a97ec3e48783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:16:33Z,use_quota=True,user_id='cdfb96de2d4b431781de239550500f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aead4fc3-1645-497d-b304-440a59ad22c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aead4fc3-1645-497d-b304-440a59ad22c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1e20fd-1f18-4880-8a6b-696850057a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a1e20fd-1f18-4880-8a6b-696850057a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a5f7dc-2e20-4451-bc39-45293b370394', 'volume_name': 'volume-05a5f7dc-2e20-4451-bc39-45293b370394', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61be85d5-4115-4ce8-8357-6a0a9392444f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61be85d5-4115-4ce8-8357-6a0a9392444f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0732e086-901b-4773-b328-dcbdd68172eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:32 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Volume 05a5f7dc-2e20-4451-bc39-45293b370394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a5f7dc-2e20-4451-bc39-45293b370394', 'volume_size': 1} Sep 04 19:16:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:16:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-371012617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a5f7dc-2e20-4451-bc39-45293b370394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63033f8e386497c8402a97ec3e48783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:16:33Z,use_quota=True,user_id='cdfb96de2d4b431781de239550500f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:16:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Creating volume 05a5f7dc-2e20-4451-bc39-45293b370394 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:16:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:16:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:16:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:16:33 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:16:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:33 devstack sudo[99959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 1073741824 Sep 04 19:16:33 devstack sudo[99959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:33 devstack sudo[99959]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 1073741824" returned: 0 in 0.711s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:33 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 Sep 04 19:16:33 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:34 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394" returned: 0 in 0.341s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] <== create_volume: return (1119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:16:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0732e086-901b-4773-b328-dcbdd68172eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a5f7dc-2e20-4451-bc39-45293b370394', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7394303-477e-41a3-bf58-e1d6cf0948fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:34 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Volume volume-05a5f7dc-2e20-4451-bc39-45293b370394 (05a5f7dc-2e20-4451-bc39-45293b370394): created successfully Sep 04 19:16:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7394303-477e-41a3-bf58-e1d6cf0948fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Flow 'volume_create_manager' (28cda461-b47e-434c-bd72-4a6e48d4485c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:16:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-bd35ef69-39e8-40f0-b256-4284844d0df6 tempest-VolumesSnapshotTestJSON-663916029 None] Created volume successfully. Sep 04 19:16:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-e094b41d-8c22-4743-8f66-e767dd76e03c req-1a2da4c0-d666-4073-be38-38482750895b tempest-TestServerVolumeAttachmentScenario-1469587397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-e094b41d-8c22-4743-8f66-e767dd76e03c req-1a2da4c0-d666-4073-be38-38482750895b tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-e094b41d-8c22-4743-8f66-e767dd76e03c req-1a2da4c0-d666-4073-be38-38482750895b tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] Creating offline snapshot 33e32436-e2ef-4452-92be-2da99f57cbb0 of volume 05a5f7dc-2e20-4451-bc39-45293b370394 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:16:35 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9307d4-b240-4cee-b450-f53c8076bbe5]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:16:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-e094b41d-8c22-4743-8f66-e767dd76e03c req-1a2da4c0-d666-4073-be38-38482750895b tempest-TestServerVolumeAttachmentScenario-1469587397 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5cbe5f07-6674-4374-9d9f-2239495c1dee', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:16:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-e094b41d-8c22-4743-8f66-e767dd76e03c req-1a2da4c0-d666-4073-be38-38482750895b tempest-TestServerVolumeAttachmentScenario-1469587397 None] attachment_update completed successfully. Sep 04 19:16:35 devstack sudo[100021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 Sep 04 19:16:35 devstack sudo[100021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:36 devstack sudo[100021]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394" returned: 0 in 0.629s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:36 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 1G Sep 04 19:16:36 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:36 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 1G" returned: 0 in 0.866s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05a5f7dc-2e20-4451-bc39-45293b370394 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:36 devstack sudo[100477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05a5f7dc-2e20-4451-bc39-45293b370394 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 Sep 04 19:16:36 devstack sudo[100477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:37 devstack sudo[100477]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05a5f7dc-2e20-4451-bc39-45293b370394 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0" returned: 0 in 0.418s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:37 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 is being set with open permissions: ugo+rw Sep 04 19:16:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:37 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 Sep 04 19:16:37 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:37 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0" returned: 0 in 0.301s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:37 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.info Sep 04 19:16:37 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:38 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.info" returned: 0 in 0.313s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:38 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.info is being set with open permissions: ugo+rw Sep 04 19:16:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:38 devstack sudo[100495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.info Sep 04 19:16:38 devstack sudo[100495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:38 devstack sudo[100495]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.info" returned: 0 in 0.372s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.040s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-eeef124c-75fd-4379-a23a-75acab875ce4 tempest-VolumesSnapshotTestJSON-663916029 None] Create snapshot completed successfully Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Flow 'volume_create_manager' (bebeec5f-ddcb-4645-9817-ed5613ebc4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7f1a82-dd61-4eef-8e03-b907518239d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf7f1a82-dd61-4eef-8e03-b907518239d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-792309105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edd95b32-4db3-4e7a-8e49-9230c9ce069e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63033f8e386497c8402a97ec3e48783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:16:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=33e32436-e2ef-4452-92be-2da99f57cbb0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:16:39Z,use_quota=True,user_id='cdfb96de2d4b431781de239550500f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0785c7f0-2e71-4fc5-a1a3-649ffe837b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0785c7f0-2e71-4fc5-a1a3-649ffe837b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3231c106-665f-4563-b108-5175dec72f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3231c106-665f-4563-b108-5175dec72f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'edd95b32-4db3-4e7a-8e49-9230c9ce069e', 'volume_name': 'volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e', 'volume_size': 2, 'snapshot_id': '33e32436-e2ef-4452-92be-2da99f57cbb0'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998d2ca5-fb3c-4435-9cb5-66a0837b7803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (998d2ca5-fb3c-4435-9cb5-66a0837b7803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbdf67c-5a89-43f5-b8d9-f4719b6378b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:39 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Volume edd95b32-4db3-4e7a-8e49-9230c9ce069e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e', 'volume_size': 2, 'snapshot_id': '33e32436-e2ef-4452-92be-2da99f57cbb0'} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-quobyte-33e32436-e2ef-4452-92be-2da99f57cbb0-edd95b32-4db3-4e7a-8e49-9230c9ce069e" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-33e32436-e2ef-4452-92be-2da99f57cbb0-edd95b32-4db3-4e7a-8e49-9230c9ce069e" acquired by "_create_volume_from_snapshot" :: waited 0.041s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Creating volume edd95b32-4db3-4e7a-8e49-9230c9ce069e from snapshot 33e32436-e2ef-4452-92be-2da99f57cbb0 {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-quobyte-edd95b32-4db3-4e7a-8e49-9230c9ce069e" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-edd95b32-4db3-4e7a-8e49-9230c9ce069e" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] snapshot: 33e32436-e2ef-4452-92be-2da99f57cbb0, volume: edd95b32-4db3-4e7a-8e49-9230c9ce069e, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[545aa80b-85d4-4d96-8b86-c0667a1f1aeb]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Flow 'volume_create_manager' (fa280ab2-ce58-45b8-873e-3f250b6ef371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:16:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1379f5-c62a-4561-a4dc-ecf540fcc41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff1379f5-c62a-4561-a4dc-ecf540fcc41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1599351166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296cf49a-bcf5-4598-a57d-c71718edde2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc541dc4999f40d18beb81343c682a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:16:40Z,use_quota=True,user_id='0d87bf19c4a34bcfa56520d7692323a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0844ffd4-a045-4ad8-a14c-f9a8a26ab2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0844ffd4-a045-4ad8-a14c-f9a8a26ab2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:40 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 Sep 04 19:16:40 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c631d95-f3b7-4081-a586-b8ff46eea9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c631d95-f3b7-4081-a586-b8ff46eea9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '296cf49a-bcf5-4598-a57d-c71718edde2c', 'volume_name': 'volume-296cf49a-bcf5-4598-a57d-c71718edde2c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199ce776-5d78-4fee-9507-b78434915640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199ce776-5d78-4fee-9507-b78434915640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69ee940-d605-47ca-8c20-8d9efb95d845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:40 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Volume 296cf49a-bcf5-4598-a57d-c71718edde2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-296cf49a-bcf5-4598-a57d-c71718edde2c', 'volume_size': 1} Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:40 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0" returned: 0 in 0.544s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05a5f7dc-2e20-4451-bc39-45293b370394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3947ae-f1a8-4dae-953e-d5ba77313270]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:40 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 Sep 04 19:16:40 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:40 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394" returned: 0 in 0.496s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Path /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 19:16:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:40 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e Sep 04 19:16:40 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-9a6d480e-822d-4831-911a-beb0465933d3 req-e283ff29-a771-4a16-b652-9afd77917714 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:16:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:16:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:16:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:45 devstack sudo[100535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:16:45 devstack sudo[100535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:45 devstack sudo[100535]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.798s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:16:46 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:16:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:16:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:16:46 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e" returned: 0 in 5.924s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:46 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:16:46 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Converted 1024.00 MB image at 172.83 MB/s Sep 04 19:16:46 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e is being set with open permissions: ugo+rw Sep 04 19:16:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:46 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e Sep 04 19:16:46 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:47 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e" returned: 0 in 0.247s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-edd95b32-4db3-4e7a-8e49-9230c9ce069e" released by "_copy_volume_from_snapshot" :: held 7.340s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-33e32436-e2ef-4452-92be-2da99f57cbb0-edd95b32-4db3-4e7a-8e49-9230c9ce069e" released by "_create_volume_from_snapshot" :: held 7.449s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.492s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.097s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:16:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1599351166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=296cf49a-bcf5-4598-a57d-c71718edde2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc541dc4999f40d18beb81343c682a58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:16:40Z,use_quota=True,user_id='0d87bf19c4a34bcfa56520d7692323a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Creating volume 296cf49a-bcf5-4598-a57d-c71718edde2c {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:16:47 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-296cf49a-bcf5-4598-a57d-c71718edde2c 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:47 devstack sudo[100542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-296cf49a-bcf5-4598-a57d-c71718edde2c 1073741824 Sep 04 19:16:47 devstack sudo[100542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbdf67c-5a89-43f5-b8d9-f4719b6378b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e', 'volume_size': 2, 'snapshot_id': '33e32436-e2ef-4452-92be-2da99f57cbb0'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e847fc2-6ad9-427a-8cde-c5c28d933061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:47 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Volume volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e (edd95b32-4db3-4e7a-8e49-9230c9ce069e): created successfully Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e847fc2-6ad9-427a-8cde-c5c28d933061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Flow 'volume_create_manager' (bebeec5f-ddcb-4645-9817-ed5613ebc4aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:16:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f5634f13-7ee8-4c0f-aa9a-b51d8dad7a56 tempest-VolumesSnapshotTestJSON-663916029 None] Created volume successfully. Sep 04 19:16:47 devstack sudo[100542]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-296cf49a-bcf5-4598-a57d-c71718edde2c 1073741824" returned: 0 in 0.444s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-296cf49a-bcf5-4598-a57d-c71718edde2c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:47 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-296cf49a-bcf5-4598-a57d-c71718edde2c Sep 04 19:16:47 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-edd95b32-4db3-4e7a-8e49-9230c9ce069e-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-edd95b32-4db3-4e7a-8e49-9230c9ce069e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:47 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-quobyte-edd95b32-4db3-4e7a-8e49-9230c9ce069e" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-296cf49a-bcf5-4598-a57d-c71718edde2c" returned: 0 in 0.335s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-9a6d480e-822d-4831-911a-beb0465933d3 req-e283ff29-a771-4a16-b652-9afd77917714 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.656s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f69ee940-d605-47ca-8c20-8d9efb95d845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-296cf49a-bcf5-4598-a57d-c71718edde2c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22dea8e-9de4-4c0d-8885-38b07805f129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-edd95b32-4db3-4e7a-8e49-9230c9ce069e" acquired by "delete_volume" :: waited 0.050s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-9a6d480e-822d-4831-911a-beb0465933d3 req-e283ff29-a771-4a16-b652-9afd77917714 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.061s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:48 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Volume volume-296cf49a-bcf5-4598-a57d-c71718edde2c (296cf49a-bcf5-4598-a57d-c71718edde2c): created successfully Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a22dea8e-9de4-4c0d-8885-38b07805f129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Flow 'volume_create_manager' (fa280ab2-ce58-45b8-873e-3f250b6ef371) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf022ad1-e035-48e6-ad60-64c0687d4fb9]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2e844e20-027a-457b-90fc-04eba2fe44f4 tempest-TestMinimumBasicScenario-388994978 None] Created volume successfully. Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-9a6d480e-822d-4831-911a-beb0465933d3 req-e283ff29-a771-4a16-b652-9afd77917714 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-d6f73295-4c00-45f4-a067-eb8c1addd727', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '81f62640-6091-4c91-a245-dcf54aaa7c85', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:16:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-9a6d480e-822d-4831-911a-beb0465933d3 req-e283ff29-a771-4a16-b652-9afd77917714 tempest-TestServerVolumeAttachmentScenario-1469587397 None] attachment_update completed successfully. Sep 04 19:16:48 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e Sep 04 19:16:48 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:48 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e" returned: 0 in 0.471s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:48 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e Sep 04 19:16:48 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:48 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-edd95b32-4db3-4e7a-8e49-9230c9ce069e" returned: 0 in 0.297s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-edd95b32-4db3-4e7a-8e49-9230c9ce069e" released by "delete_volume" :: held 0.837s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Created reservations ['de8b03d9-3146-44bc-811d-4367bb11c6b3', 'dfb7b942-ddfb-4e13-89d6-3ca6f2d5fbb1', '52d6e808-cf15-4260-8d6c-e0b2a5a06647', '4872f767-11fc-4ed1-97f1-47c6b3986cbb'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:49 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:16:49 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-33e32436-e2ef-4452-92be-2da99f57cbb0-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-33e32436-e2ef-4452-92be-2da99f57cbb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-quobyte-05a5f7dc-2e20-4451-bc39-45293b370394" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-05a5f7dc-2e20-4451-bc39-45293b370394" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-quobyte-33e32436-e2ef-4452-92be-2da99f57cbb0" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-33e32436-e2ef-4452-92be-2da99f57cbb0" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Deleting offline snapshot 33e32436-e2ef-4452-92be-2da99f57cbb0 of volume 05a5f7dc-2e20-4451-bc39-45293b370394 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:16:49 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] snapshot_file for this snap is: volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:16:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.465s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:49 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:16:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Deleted volume successfully. Sep 04 19:16:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9a440a-3925-4699-976d-799d79e1cfc0]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:16:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-489fe79e-3c42-4e70-bfba-650b983d8313 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-edd95b32-4db3-4e7a-8e49-9230c9ce069e-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:49 devstack sudo[100567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 Sep 04 19:16:49 devstack sudo[100567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:50 devstack sudo[100567]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0" returned: 0 in 0.747s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05a5f7dc-2e20-4451-bc39-45293b370394(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:16:50 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a09328-f78a-4ce2-a461-24d88ac65ea3]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:16:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:50 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 Sep 04 19:16:50 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-fa77902d-9c82-4fe4-a294-2adff76c6da0 req-c46cef63-f66a-43b6-a685-296ee5364283 tempest-TestMinimumBasicScenario-388994978 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-fa77902d-9c82-4fe4-a294-2adff76c6da0 req-c46cef63-f66a-43b6-a685-296ee5364283 tempest-TestMinimumBasicScenario-388994978 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-fa77902d-9c82-4fe4-a294-2adff76c6da0 req-c46cef63-f66a-43b6-a685-296ee5364283 tempest-TestMinimumBasicScenario-388994978 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:50 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-0412be3e-8e1c-4e8b-9894-d1c20cbf3289 req-0e9b2df7-90b8-483b-837b-7b57764c7467 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Terminate volume connection completed successfully. Sep 04 19:16:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-0412be3e-8e1c-4e8b-9894-d1c20cbf3289 req-0e9b2df7-90b8-483b-837b-7b57764c7467 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Deleting attachment 81f62640-6091-4c91-a245-dcf54aaa7c85. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:16:50 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-fa77902d-9c82-4fe4-a294-2adff76c6da0 req-c46cef63-f66a-43b6-a685-296ee5364283 tempest-TestMinimumBasicScenario-388994978 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-296cf49a-bcf5-4598-a57d-c71718edde2c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fcc7a372-37f2-4bdd-b849-bba3f6d92071', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:16:50 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-fa77902d-9c82-4fe4-a294-2adff76c6da0 req-c46cef63-f66a-43b6-a685-296ee5364283 tempest-TestMinimumBasicScenario-388994978 None] attachment_update completed successfully. Sep 04 19:16:51 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394" returned: 0 in 0.707s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:51 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 Sep 04 19:16:51 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:51 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0" returned: 0 in 0.592s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:51 devstack sudo[100641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0 Sep 04 19:16:51 devstack sudo[100641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:51 devstack sudo[100641]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394.33e32436-e2ef-4452-92be-2da99f57cbb0" returned: 0 in 0.303s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-33e32436-e2ef-4452-92be-2da99f57cbb0" released by "_delete_snapshot" :: held 2.522s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-05a5f7dc-2e20-4451-bc39-45293b370394" released by "delete_snapshot" :: held 2.559s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:52 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Created reservations ['e4f512e5-bbf1-4829-9cc7-5b446254e9f3', 'b81f2654-46f3-457c-8b5e-e7dac39b2b6e', 'ebbd762b-cf71-46d5-954b-3017d29b723b', 'dbea637b-5252-4d7e-9d94-cf982aa2127e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:16:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Delete snapshot completed successfully. Sep 04 19:16:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-773ea9cd-f2ae-4e31-8e07-915ba48fd089 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-33e32436-e2ef-4452-92be-2da99f57cbb0-delete_snapshot" released by "delete_snapshot" :: held 2.733s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-20364f2f-3f45-4046-810e-cd313f69d6e4 req-9ed46050-6f2c-470d-a828-14377a9469d1 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Terminate volume connection completed successfully. Sep 04 19:16:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-20364f2f-3f45-4046-810e-cd313f69d6e4 req-9ed46050-6f2c-470d-a828-14377a9469d1 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Deleting attachment 5cbe5f07-6674-4374-9d9f-2239495c1dee. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:16:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-05a5f7dc-2e20-4451-bc39-45293b370394-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-05a5f7dc-2e20-4451-bc39-45293b370394-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-quobyte-05a5f7dc-2e20-4451-bc39-45293b370394" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-05a5f7dc-2e20-4451-bc39-45293b370394" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:52 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcab2f0-c0d2-4ee3-94c9-f3769be16402]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:16:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:52 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 Sep 04 19:16:52 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:53 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394" returned: 0 in 0.426s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:53 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394 Sep 04 19:16:53 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:53 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-05a5f7dc-2e20-4451-bc39-45293b370394" returned: 0 in 0.303s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-05a5f7dc-2e20-4451-bc39-45293b370394" released by "delete_volume" :: held 0.796s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:53 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Created reservations ['d43e2cae-c99e-4827-83cb-676cc56230c5', '3cfd6095-a32f-47f7-a663-496ba80fdb20', 'a18283b9-6d57-4caf-926e-59f381b3eca1', '637870a2-8589-43f5-8181-8122d02d2e52'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:16:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:16:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:16:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:53 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:16:53 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:54 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.360s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:16:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Deleted volume successfully. Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-37ba28cd-b8fd-4836-8ba6-7b87fee5ce69 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-05a5f7dc-2e20-4451-bc39-45293b370394-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Flow 'volume_create_manager' (e7d85294-0242-428d-a08f-b785ea3a95ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f880c07-604e-45aa-96d7-76fa9fb0b2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f880c07-604e-45aa-96d7-76fa9fb0b2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1211997240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5080e5-0734-44ae-8bb1-e0ed2eb7701c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63033f8e386497c8402a97ec3e48783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:16:55Z,use_quota=True,user_id='cdfb96de2d4b431781de239550500f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c2fa90-5983-42a1-9bdd-2ac5879db0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36c2fa90-5983-42a1-9bdd-2ac5879db0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4617a339-cb57-45c1-ae27-c0fdc64e9826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4617a339-cb57-45c1-ae27-c0fdc64e9826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b5080e5-0734-44ae-8bb1-e0ed2eb7701c', 'volume_name': 'volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a59328f-e6ca-4683-96d2-221fd379d5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a59328f-e6ca-4683-96d2-221fd379d5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafe747c-e169-43ae-bc54-a5989441b4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:54 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Volume 0b5080e5-0734-44ae-8bb1-e0ed2eb7701c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c', 'volume_size': 1} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1211997240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5080e5-0734-44ae-8bb1-e0ed2eb7701c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63033f8e386497c8402a97ec3e48783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:16:55Z,use_quota=True,user_id='cdfb96de2d4b431781de239550500f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Creating volume 0b5080e5-0734-44ae-8bb1-e0ed2eb7701c {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:16:54 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:16:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:54 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c 1073741824 Sep 04 19:16:54 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:55 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c 1073741824" returned: 0 in 0.542s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:55 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c Sep 04 19:16:55 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:55 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c" returned: 0 in 0.330s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:16:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafe747c-e169-43ae-bc54-a5989441b4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f412e63-4746-4a1d-93e0-7337393a0034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:16:55 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Volume volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c (0b5080e5-0734-44ae-8bb1-e0ed2eb7701c): created successfully Sep 04 19:16:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f412e63-4746-4a1d-93e0-7337393a0034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:16:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Flow 'volume_create_manager' (e7d85294-0242-428d-a08f-b785ea3a95ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:16:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-91240775-9a7b-4ef4-b9f7-b00c44e3b36c tempest-VolumesSnapshotTestJSON-663916029 None] Created volume successfully. Sep 04 19:16:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] Creating offline snapshot 587f0cf5-a7a4-4c95-9d63-6c32650bf249 of volume 0b5080e5-0734-44ae-8bb1-e0ed2eb7701c {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:16:56 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[46897f3a-7c7e-441b-95e1-59ff1683c3ce]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:16:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:57 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c Sep 04 19:16:57 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:57 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c" returned: 0 in 0.451s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:57 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 1G Sep 04 19:16:57 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:58 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 1G" returned: 0 in 0.653s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Acquiring lock "cinder-d6f73295-4c00-45f4-a067-eb8c1addd727-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:58 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 Sep 04 19:16:58 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "cinder-d6f73295-4c00-45f4-a067-eb8c1addd727-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Acquiring lock "cinder-quobyte-d6f73295-4c00-45f4-a067-eb8c1addd727" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "cinder-quobyte-d6f73295-4c00-45f4-a067-eb8c1addd727" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6670a9a4-e0f3-4cc6-95f6-7435cdda25e2]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:16:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d6f73295-4c00-45f4-a067-eb8c1addd727 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:58 devstack sudo[100733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d6f73295-4c00-45f4-a067-eb8c1addd727 Sep 04 19:16:58 devstack sudo[100733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:58 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249" returned: 0 in 0.414s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:58 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 is being set with open permissions: ugo+rw Sep 04 19:16:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:58 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 Sep 04 19:16:58 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:58 devstack sudo[100733]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d6f73295-4c00-45f4-a067-eb8c1addd727" returned: 0 in 0.483s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d6f73295-4c00-45f4-a067-eb8c1addd727 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:58 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d6f73295-4c00-45f4-a067-eb8c1addd727 Sep 04 19:16:58 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:58 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249" returned: 0 in 0.317s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:58 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.info Sep 04 19:16:58 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:59 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d6f73295-4c00-45f4-a067-eb8c1addd727" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "cinder-quobyte-d6f73295-4c00-45f4-a067-eb8c1addd727" released by "delete_volume" :: held 0.829s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Created reservations ['4dbb6d1a-9a1d-4d6a-b86c-580e710d2738', '09d56a5b-e6b9-4cc0-8e02-904dd8274aa5', '7168fb71-7777-4904-9331-58bcf4df3e7d', 'bda6eb39-6382-4d9b-94cb-33a8d311c35b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:16:59 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.info" returned: 0 in 0.385s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:59 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.info is being set with open permissions: ugo+rw Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:59 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.info Sep 04 19:16:59 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:59 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:16:59 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Acquiring lock "cinder-3cba3a01-8fc2-46ae-a94d-a715913b53cb-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "cinder-3cba3a01-8fc2-46ae-a94d-a715913b53cb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Acquiring lock "cinder-quobyte-3cba3a01-8fc2-46ae-a94d-a715913b53cb" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "cinder-quobyte-3cba3a01-8fc2-46ae-a94d-a715913b53cb" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:16:59 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.info" returned: 0 in 0.372s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.721s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5496d3-7791-42a8-ba4a-012ef4ec6bab]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:16:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3e007763-0b7d-4836-acdd-8e9e0463ef55 tempest-VolumesSnapshotTestJSON-663916029 None] Create snapshot completed successfully Sep 04 19:16:59 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.447s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:16:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Deleted volume successfully. Sep 04 19:16:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aacc9ce3-02a2-446d-a984-ad41bf7f56e9 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "cinder-d6f73295-4c00-45f4-a067-eb8c1addd727-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:16:59 devstack sudo[100757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb Sep 04 19:16:59 devstack sudo[100757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:00 devstack sudo[100757]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb" returned: 0 in 0.577s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:00 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb Sep 04 19:17:00 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:00 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3cba3a01-8fc2-46ae-a94d-a715913b53cb" returned: 0 in 0.325s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "cinder-quobyte-3cba3a01-8fc2-46ae-a94d-a715913b53cb" released by "delete_volume" :: held 1.005s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:17:00 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Created reservations ['c2c99f6c-a575-4c5a-ae2a-d5faa48aabde', '5ad2f3f4-ab9a-49da-bee0-5aff0cee1620', 'cb12de4e-2561-4268-9416-e1a62446392f', 'fde94b09-e045-4154-8763-b804fcf4e08a'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:17:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:17:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:17:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:17:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:17:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:17:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:00 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:17:00 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Flow 'volume_create_manager' (3a4abd7c-3850-4af2-ae2e-f8010c90d4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fde815-ca9e-4ec6-aa8d-19c00020304a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:17:01 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fde815-ca9e-4ec6-aa8d-19c00020304a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-207978118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cec71e6-79d1-49f8-bbb4-0c59912e8722,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d63033f8e386497c8402a97ec3e48783',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=587f0cf5-a7a4-4c95-9d63-6c32650bf249,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:17:01Z,use_quota=True,user_id='cdfb96de2d4b431781de239550500f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba59dde-5ebf-4f85-8537-c9e83d49b470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba59dde-5ebf-4f85-8537-c9e83d49b470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4799dfc-fe91-4c9a-ad56-b25e122ed4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4799dfc-fe91-4c9a-ad56-b25e122ed4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7cec71e6-79d1-49f8-bbb4-0c59912e8722', 'volume_name': 'volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722', 'volume_size': 1, 'snapshot_id': '587f0cf5-a7a4-4c95-9d63-6c32650bf249'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60be8715-2553-47c1-af3d-47058998258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60be8715-2553-47c1-af3d-47058998258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d708ae03-6aab-4d0e-b6b5-7163536167f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:17:01 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Volume 7cec71e6-79d1-49f8-bbb4-0c59912e8722: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722', 'volume_size': 1, 'snapshot_id': '587f0cf5-a7a4-4c95-9d63-6c32650bf249'} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.310s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-quobyte-587f0cf5-a7a4-4c95-9d63-6c32650bf249-7cec71e6-79d1-49f8-bbb4-0c59912e8722" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:17:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Deleted volume successfully. Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-587f0cf5-a7a4-4c95-9d63-6c32650bf249-7cec71e6-79d1-49f8-bbb4-0c59912e8722" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Creating volume 7cec71e6-79d1-49f8-bbb4-0c59912e8722 from snapshot 587f0cf5-a7a4-4c95-9d63-6c32650bf249 {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-quobyte-7cec71e6-79d1-49f8-bbb4-0c59912e8722" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-82ff38cb-b50e-493d-9a16-0e38944cee73 tempest-TestServerVolumeAttachmentScenario-1469587397 None] Lock "cinder-3cba3a01-8fc2-46ae-a94d-a715913b53cb-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-7cec71e6-79d1-49f8-bbb4-0c59912e8722" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] snapshot: 587f0cf5-a7a4-4c95-9d63-6c32650bf249, volume: 7cec71e6-79d1-49f8-bbb4-0c59912e8722, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5ce1a7-c285-424e-ad94-60293adc2787]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:01 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 Sep 04 19:17:01 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:01 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249" returned: 0 in 0.431s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbe4cae-064c-49bc-8240-2cf0ac83dba7]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:17:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:01 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c Sep 04 19:17:01 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:02 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c" returned: 0 in 0.368s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 19:17:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 19:17:02 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Path /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722 not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 19:17:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:02 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722 Sep 04 19:17:02 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:07 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722" returned: 0 in 5.609s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:07 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c, size 1024.00 MB, duration 5.61 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:17:07 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Converted 1024.00 MB image at 182.51 MB/s Sep 04 19:17:07 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722 is being set with open permissions: ugo+rw Sep 04 19:17:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:07 devstack sudo[100832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722 Sep 04 19:17:07 devstack sudo[100832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:07 devstack sudo[100832]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-7cec71e6-79d1-49f8-bbb4-0c59912e8722" released by "_copy_volume_from_snapshot" :: held 6.782s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:17:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-587f0cf5-a7a4-4c95-9d63-6c32650bf249-7cec71e6-79d1-49f8-bbb4-0c59912e8722" released by "_create_volume_from_snapshot" :: held 6.867s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:17:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.894s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:17:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d708ae03-6aab-4d0e-b6b5-7163536167f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722', 'volume_size': 1, 'snapshot_id': '587f0cf5-a7a4-4c95-9d63-6c32650bf249'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:17:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f816f252-0e05-447e-a29c-0ce63b039bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:17:08 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Volume volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722 (7cec71e6-79d1-49f8-bbb4-0c59912e8722): created successfully Sep 04 19:17:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f816f252-0e05-447e-a29c-0ce63b039bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:17:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Flow 'volume_create_manager' (3a4abd7c-3850-4af2-ae2e-f8010c90d4e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:17:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-372fb87f-b262-4c2f-84a9-4c6b6198ebb5 tempest-VolumesSnapshotTestJSON-663916029 None] Created volume successfully. Sep 04 19:17:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-7cec71e6-79d1-49f8-bbb4-0c59912e8722-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:17:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-7cec71e6-79d1-49f8-bbb4-0c59912e8722-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:17:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-quobyte-7cec71e6-79d1-49f8-bbb4-0c59912e8722" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:17:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-7cec71e6-79d1-49f8-bbb4-0c59912e8722" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:17:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae96a3a-262f-42cd-aa05-24ce9e84a2c7]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:17:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:09 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722 Sep 04 19:17:09 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:09 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722" returned: 0 in 0.410s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:09 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722 Sep 04 19:17:09 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:09 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7cec71e6-79d1-49f8-bbb4-0c59912e8722" returned: 0 in 0.261s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-7cec71e6-79d1-49f8-bbb4-0c59912e8722" released by "delete_volume" :: held 0.716s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:17:09 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Created reservations ['ed41f1e4-0660-45f3-b87a-d5369c2011ff', '7c56eaf7-d1cc-4b58-90e8-46850ea5ceab', '95d901ba-d46e-4946-859e-5d17ea3257e2', '232fd1d2-bc10-4980-8669-ab25e700f3c5'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:17:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:17:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:17:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:17:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:17:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:17:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:09 devstack sudo[100844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:17:09 devstack sudo[100844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:10 devstack sudo[100844]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.297s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:17:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Deleted volume successfully. Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-587f0cf5-a7a4-4c95-9d63-6c32650bf249-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-587f0cf5-a7a4-4c95-9d63-6c32650bf249-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-quobyte-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c309fef6-b701-483a-aeba-4b3475596363 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-7cec71e6-79d1-49f8-bbb4-0c59912e8722-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-quobyte-587f0cf5-a7a4-4c95-9d63-6c32650bf249" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-587f0cf5-a7a4-4c95-9d63-6c32650bf249" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Deleting offline snapshot 587f0cf5-a7a4-4c95-9d63-6c32650bf249 of volume 0b5080e5-0734-44ae-8bb1-e0ed2eb7701c {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] snapshot_file for this snap is: volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[351d4d0c-0e3e-4dee-9fe7-2e44c10c2bc4]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:10 devstack sudo[100847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 Sep 04 19:17:10 devstack sudo[100847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:10 devstack sudo[100847]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249" returned: 0 in 0.426s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4ff4b0-05b2-4d5b-b40e-8fbb338aa012]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:17:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:10 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c Sep 04 19:17:10 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:11 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c" returned: 0 in 0.559s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:11 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 Sep 04 19:17:11 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:11 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249" returned: 0 in 0.391s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:11 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249 Sep 04 19:17:11 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:12 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c.587f0cf5-a7a4-4c95-9d63-6c32650bf249" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-587f0cf5-a7a4-4c95-9d63-6c32650bf249" released by "_delete_snapshot" :: held 1.752s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:17:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c" released by "delete_snapshot" :: held 1.779s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:17:12 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Created reservations ['fef5562c-7288-486a-bca7-ec5058455e99', 'c96a5445-c5f0-4a21-8a07-432ed1bff918', '06a3c2aa-2084-4ac7-b803-bc54f7845836', 'd479787d-df92-435b-a971-c9f45e1cf454'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:17:12 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Delete snapshot completed successfully. Sep 04 19:17:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-626e9d14-ffc9-48af-a263-07dd4e20ffd2 tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-587f0cf5-a7a4-4c95-9d63-6c32650bf249-delete_snapshot" released by "delete_snapshot" :: held 1.955s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:17:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:17:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:17:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-quobyte-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:17:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:17:12 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78ebf6d-7aab-4bd8-bbff-39cb03cef368]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:17:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:12 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c Sep 04 19:17:12 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:12 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c" returned: 0 in 0.386s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:13 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c Sep 04 19:17:13 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:13 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c" returned: 0 in 0.323s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c" released by "delete_volume" :: held 0.781s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Created reservations ['4a2ed229-4a97-4e0f-93f0-a6b2c2d2eff1', 'b2ab31bc-d266-415a-990c-6fb8bae8ddb3', '0b771648-6c32-4913-8c9d-70d843157f22', 'ef9a421d-1559-457b-88cb-ed300b538554'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:13 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:17:13 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "cinder-quobyte-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ad28a4-3de6-4219-ae6d-5675aa4fa021]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:13 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.431s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:17:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Deleted volume successfully. Sep 04 19:17:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-670ceaac-9f26-4ec6-93c4-c7d68332126b tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-0b5080e5-0734-44ae-8bb1-e0ed2eb7701c-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:17:14 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 Sep 04 19:17:14 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:14 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420" returned: 0 in 0.420s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:14 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420 Sep 04 19:17:14 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:14 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420" returned: 0 in 0.294s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-quobyte-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420" released by "delete_volume" :: held 0.790s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:17:14 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Created reservations ['00f12794-0b3b-4f93-9ba1-396964fd2a04', '0e71f2e4-fa21-4696-91bb-df07be871f9b', '32296a9f-9170-4f1d-80cd-be000c0aeea5', '14f336f7-60fc-44fc-9861-378f5c281e69'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:17:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:17:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:17:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:17:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:17:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:17:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:14 devstack sudo[100889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:17:14 devstack sudo[100889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:15 devstack sudo[100889]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.283s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:15 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:17:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Deleted volume successfully. Sep 04 19:17:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5f87ee1d-3d29-47b1-823f-3ffef413241c tempest-VolumesSnapshotTestJSON-663916029 None] Lock "cinder-1a8ac8dc-26ca-45b4-8bb5-b80ed4d43420-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:17:24 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=103,cinder:UPDATE=100,cinder:INSERT=26,cinder:DELETE=3 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:17:25 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=107,cinder:UPDATE=101,cinder:DELETE=13,cinder:INSERT=23 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:17:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-c65069c2-82bf-4701-80e5-5d23536d69fb req-5f1fcf3b-9fa6-45e4-99f1-e9f281e882f3 tempest-TestMinimumBasicScenario-388994978 None] Terminate volume connection completed successfully. Sep 04 19:17:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-c65069c2-82bf-4701-80e5-5d23536d69fb req-5f1fcf3b-9fa6-45e4-99f1-e9f281e882f3 tempest-TestMinimumBasicScenario-388994978 None] Deleting attachment fcc7a372-37f2-4bdd-b849-bba3f6d92071. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:17:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Acquiring lock "cinder-296cf49a-bcf5-4598-a57d-c71718edde2c-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:17:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Lock "cinder-296cf49a-bcf5-4598-a57d-c71718edde2c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:17:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Acquiring lock "cinder-quobyte-296cf49a-bcf5-4598-a57d-c71718edde2c" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:17:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Lock "cinder-quobyte-296cf49a-bcf5-4598-a57d-c71718edde2c" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:17:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6116d65e-c0c4-4943-8fbf-3e927fc9f8ba]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:17:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-296cf49a-bcf5-4598-a57d-c71718edde2c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:40 devstack sudo[100949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-296cf49a-bcf5-4598-a57d-c71718edde2c Sep 04 19:17:40 devstack sudo[100949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:40 devstack sudo[100949]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-296cf49a-bcf5-4598-a57d-c71718edde2c" returned: 0 in 0.491s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-296cf49a-bcf5-4598-a57d-c71718edde2c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:40 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-296cf49a-bcf5-4598-a57d-c71718edde2c Sep 04 19:17:40 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:41 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-296cf49a-bcf5-4598-a57d-c71718edde2c" returned: 0 in 0.384s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Lock "cinder-quobyte-296cf49a-bcf5-4598-a57d-c71718edde2c" released by "delete_volume" :: held 0.931s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:17:41 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Created reservations ['d52779f2-1590-4246-819c-3701e8898d36', 'fab47649-c4ae-4ff0-888f-32c5704f0323', '084c4a9a-0863-4a76-b442-81d9f29c9578', '5361f2c6-198f-4342-bbb0-ffd202ca70ba'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:17:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:17:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:17:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:17:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:17:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:17:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:41 devstack sudo[100958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:17:41 devstack sudo[100958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:41 devstack sudo[100958]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.287s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:41 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:17:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Deleted volume successfully. Sep 04 19:17:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c7ea6649-3897-47a4-98c3-cc8a5659b5e5 tempest-TestMinimumBasicScenario-388994978 None] Lock "cinder-296cf49a-bcf5-4598-a57d-c71718edde2c-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:45 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:17:45 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Flow 'volume_create_manager' (33ba9438-c3ab-4b68-a715-ea88fc26b980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e47272e-6910-43e2-9bbc-d76fd4c40142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e47272e-6910-43e2-9bbc-d76fd4c40142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-34343018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8091bf3-65cc-49be-baff-6e4c80202d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6aab05544fe4c3a8fbea651f3dfb244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:17:45Z,use_quota=True,user_id='2ed18cb5bb134822bfad25c0d2db8a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bdb0942-530b-4884-93c8-36a56248f99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bdb0942-530b-4884-93c8-36a56248f99e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53891ea0-ee4c-4336-bbd6-5157bc659cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 19:17:45 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.309s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:17:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:17:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53891ea0-ee4c-4336-bbd6-5157bc659cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd8091bf3-65cc-49be-baff-6e4c80202d4e', 'volume_name': 'volume-d8091bf3-65cc-49be-baff-6e4c80202d4e', 'volume_size': 1, 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd0ece6d722f24154ab955bf866d06cbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'created_at': datetime.datetime(2026, 9, 4, 16, 58, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 58, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e637b08c-391d-4edc-8402-9ba212deb71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:17:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fa0bbc-6556-4dc4-b72a-176fcd705cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:17:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51fa0bbc-6556-4dc4-b72a-176fcd705cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:17:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14bcddbe-e6a4-47df-9385-05e0a810da61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:17:46 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Volume d8091bf3-65cc-49be-baff-6e4c80202d4e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d8091bf3-65cc-49be-baff-6e4c80202d4e', 'volume_size': 1, 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd0ece6d722f24154ab955bf866d06cbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'created_at': datetime.datetime(2026, 9, 4, 16, 58, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 58, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e637b08c-391d-4edc-8402-9ba212deb71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 04 19:17:46 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Trying to clone d8091bf3-65cc-49be-baff-6e4c80202d4e from image e637b08c-391d-4edc-8402-9ba212deb71d at location (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 19:17:46 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_8tl2x61qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 19:17:46 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Image download 20.69 MB at 20.69 MB/s Sep 04 19:17:46 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2e4d37-219c-4d8c-b2e4-73b0e4681078]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:17:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_8tl2x61qdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:46 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_8tl2x61qdevstack@QuobyteHD Sep 04 19:17:46 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:46 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_8tl2x61qdevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:46 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Temporary image e637b08c-391d-4edc-8402-9ba212deb71d is fetched for user 2ed18cb5bb134822bfad25c0d2db8a7c. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 19:17:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc686a03-69bd-4732-a629-c6b11e42526a]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:17:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_8tl2x61qdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:47 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_8tl2x61qdevstack@QuobyteHD Sep 04 19:17:47 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:47 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_8tl2x61qdevstack@QuobyteHD" returned: 0 in 0.429s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:17:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:17:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:17:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-34343018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8091bf3-65cc-49be-baff-6e4c80202d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6aab05544fe4c3a8fbea651f3dfb244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:17:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:17:45Z,use_quota=True,user_id='2ed18cb5bb134822bfad25c0d2db8a7c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:17:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Creating volume d8091bf3-65cc-49be-baff-6e4c80202d4e {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:17:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:17:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:17:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:17:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:17:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:17:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:17:47 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:17:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:47 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e 1073741824 Sep 04 19:17:47 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:47 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e 1073741824" returned: 0 in 0.510s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:48 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e Sep 04 19:17:48 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:48 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e" returned: 0 in 0.408s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:17:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:17:48 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Attempting download of e637b08c-391d-4edc-8402-9ba212deb71d ((None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}])) to volume d8091bf3-65cc-49be-baff-6e4c80202d4e. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 19:17:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b025f914-acf1-4614-9cf1-ab872fbca3c2]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:17:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_u1ek44h1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:48 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_u1ek44h1 Sep 04 19:17:48 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:48 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_u1ek44h1" returned: 0 in 0.383s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_u1ek44h1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:49 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_u1ek44h1 Sep 04 19:17:49 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:49 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_u1ek44h1" returned: 1 in 0.389s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e637b08c-391d-4edc-8402-9ba212deb71d_u1ek44h1' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:17:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88702a3-f96e-4486-b11d-57c5efbfc2c3]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:17:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_8tl2x61qdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:49 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_8tl2x61qdevstack@QuobyteHD Sep 04 19:17:49 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:49 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_8tl2x61qdevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:49 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] e637b08c-391d-4edc-8402-9ba212deb71d was qcow2, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 19:17:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_8tl2x61qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:49 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_8tl2x61qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e Sep 04 19:17:49 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:51 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_8tl2x61qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e" returned: 0 in 2.213s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:51 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e637b08c-391d-4edc-8402-9ba212deb71d_8tl2x61qdevstack@QuobyteHD, size 112.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:17:51 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Converted 112.00 MB image at 50.58 MB/s Sep 04 19:17:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:17:51 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e 1G Sep 04 19:17:51 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:17:52 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Sep 04 19:17:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e 1G" returned: 0 in 0.386s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:17:52 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Downloaded image e637b08c-391d-4edc-8402-9ba212deb71d ((None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}])) to volume d8091bf3-65cc-49be-baff-6e4c80202d4e successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 19:17:52 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Temporary image e637b08c-391d-4edc-8402-9ba212deb71d for user 2ed18cb5bb134822bfad25c0d2db8a7c is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 19:17:52 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Marking volume d8091bf3-65cc-49be-baff-6e4c80202d4e as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 19:17:52 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Copying metadata from image e637b08c-391d-4edc-8402-9ba212deb71d to d8091bf3-65cc-49be-baff-6e4c80202d4e. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 19:17:52 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Creating volume glance metadata for volume d8091bf3-65cc-49be-baff-6e4c80202d4e backed by image e637b08c-391d-4edc-8402-9ba212deb71d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 19:17:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14bcddbe-e6a4-47df-9385-05e0a810da61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8091bf3-65cc-49be-baff-6e4c80202d4e', 'volume_size': 1, 'image_id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e637b08c-391d-4edc-8402-9ba212deb71d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd0ece6d722f24154ab955bf866d06cbf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e637b08c-391d-4edc-8402-9ba212deb71d', 'created_at': datetime.datetime(2026, 9, 4, 16, 58, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 16, 58, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e637b08c-391d-4edc-8402-9ba212deb71d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:17:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aadea75-f482-4034-a78d-36965bd93f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:17:52 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Volume volume-d8091bf3-65cc-49be-baff-6e4c80202d4e (d8091bf3-65cc-49be-baff-6e4c80202d4e): created successfully Sep 04 19:17:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1aadea75-f482-4034-a78d-36965bd93f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:17:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Flow 'volume_create_manager' (33ba9438-c3ab-4b68-a715-ea88fc26b980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:17:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3105ab99-4470-4614-8918-93489c1e7981 tempest-TestShelveInstance-1095350994 None] Created volume successfully. Sep 04 19:17:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-b290d030-cf34-463a-84b9-018ba38794d3 req-1c23a0c8-cc6c-4153-8071-d03f174f31db tempest-TestShelveInstance-1095350994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:17:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-b290d030-cf34-463a-84b9-018ba38794d3 req-1c23a0c8-cc6c-4153-8071-d03f174f31db tempest-TestShelveInstance-1095350994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:17:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-b290d030-cf34-463a-84b9-018ba38794d3 req-1c23a0c8-cc6c-4153-8071-d03f174f31db tempest-TestShelveInstance-1095350994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:17:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-b290d030-cf34-463a-84b9-018ba38794d3 req-1c23a0c8-cc6c-4153-8071-d03f174f31db tempest-TestShelveInstance-1095350994 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-d8091bf3-65cc-49be-baff-6e4c80202d4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6cdc989f-24d4-4aee-8c30-a381ca9c356f', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:17:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-b290d030-cf34-463a-84b9-018ba38794d3 req-1c23a0c8-cc6c-4153-8071-d03f174f31db tempest-TestShelveInstance-1095350994 None] attachment_update completed successfully. Sep 04 19:18:07 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=22,cinder:INSERT=11,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:18:07 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=22,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=7 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Flow 'volume_create_manager' (3cc73565-8b31-41c7-8a1d-db9532663883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa672b8-59e9-4648-9e12-2961b2e07b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa672b8-59e9-4648-9e12-2961b2e07b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12745721-1293-4fc2-80fb-bc8d40541e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be8c6da647164f008d4e5f37c4df67eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:12Z,use_quota=True,user_id='3a40fbb29ed6481b84dfb62176eaa415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8969cf38-cb1d-4cc7-aac8-c6012fc149b3),volume_type_id=8969cf38-cb1d-4cc7-aac8-c6012fc149b3)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f384ed-6c97-4785-b3cd-255861752b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0f384ed-6c97-4785-b3cd-255861752b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3bc7a8-0b07-45e1-b20d-e80f443b93c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b3bc7a8-0b07-45e1-b20d-e80f443b93c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '12745721-1293-4fc2-80fb-bc8d40541e4d', 'volume_name': 'volume-12745721-1293-4fc2-80fb-bc8d40541e4d', 'volume_size': 1, 'image_id': 'b7823fa6-f519-42fb-950f-6ce67c6d3c13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7823fa6-f519-42fb-950f-6ce67c6d3c13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'df6688a2780b83fe2190ae2551512707', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be8c6da647164f008d4e5f37c4df67eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5ef3b8f924f3017d30ceb52816cc56d1b4b46f83634a1dd75ace6a3e5ea5b78c1eeeb93b4f39cd5e5fdc5613476854c805edc06a5b9ed5199ce8bdfc9075342', 'id': 'b7823fa6-f519-42fb-950f-6ce67c6d3c13', 'created_at': datetime.datetime(2026, 9, 4, 17, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 17, 18, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7823fa6-f519-42fb-950f-6ce67c6d3c13/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6dd669-c348-41f9-af05-873b34587198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a6dd669-c348-41f9-af05-873b34587198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7bf6ddc-d0bb-4d08-9b6e-89f69fb10734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:12 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Volume 12745721-1293-4fc2-80fb-bc8d40541e4d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-12745721-1293-4fc2-80fb-bc8d40541e4d', 'volume_size': 1, 'image_id': 'b7823fa6-f519-42fb-950f-6ce67c6d3c13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7823fa6-f519-42fb-950f-6ce67c6d3c13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'df6688a2780b83fe2190ae2551512707', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be8c6da647164f008d4e5f37c4df67eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5ef3b8f924f3017d30ceb52816cc56d1b4b46f83634a1dd75ace6a3e5ea5b78c1eeeb93b4f39cd5e5fdc5613476854c805edc06a5b9ed5199ce8bdfc9075342', 'id': 'b7823fa6-f519-42fb-950f-6ce67c6d3c13', 'created_at': datetime.datetime(2026, 9, 4, 17, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 17, 18, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7823fa6-f519-42fb-950f-6ce67c6d3c13/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Trying to clone 12745721-1293-4fc2-80fb-bc8d40541e4d from image b7823fa6-f519-42fb-950f-6ce67c6d3c13 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b7823fa6-f519-42fb-950f-6ce67c6d3c13', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 19:18:12 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Image download 0.00 MB at 0.00 MB/s Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[121a2394-0a7c-4548-8ea8-772f50bee869]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:12 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD Sep 04 19:18:12 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:12 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD" returned: 0 in 0.317s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:12 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD Sep 04 19:18:12 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:13 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD" returned: 1 in 0.336s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Temporary image b7823fa6-f519-42fb-950f-6ce67c6d3c13 is fetched for user 3a40fbb29ed6481b84dfb62176eaa415. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[32420e57-9f2a-49c1-a33f-e31a47998dd8]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:13 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD Sep 04 19:18:13 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:13 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:13 devstack sudo[101607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD Sep 04 19:18:13 devstack sudo[101607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:13 devstack sudo[101607]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD" returned: 1 in 0.315s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12745721-1293-4fc2-80fb-bc8d40541e4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='be8c6da647164f008d4e5f37c4df67eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:12Z,use_quota=True,user_id='3a40fbb29ed6481b84dfb62176eaa415',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8969cf38-cb1d-4cc7-aac8-c6012fc149b3),volume_type_id=8969cf38-cb1d-4cc7-aac8-c6012fc149b3)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Creating volume 12745721-1293-4fc2-80fb-bc8d40541e4d {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:18:13 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:18:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:13 devstack sudo[101612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d 1073741824 Sep 04 19:18:13 devstack sudo[101612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:14 devstack sudo[101612]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d 1073741824" returned: 0 in 0.424s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:14 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d Sep 04 19:18:14 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:14 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d" returned: 0 in 0.247s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:18:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:14 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Attempting download of b7823fa6-f519-42fb-950f-6ce67c6d3c13 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7823fa6-f519-42fb-950f-6ce67c6d3c13', 'metadata': {}}])) to volume 12745721-1293-4fc2-80fb-bc8d40541e4d. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 19:18:14 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6f2519-f40b-42e3-afae-6356e1baacb5]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7823fa6-f519-42fb-950f-6ce67c6d3c13_pa4xg8vm {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:14 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7823fa6-f519-42fb-950f-6ce67c6d3c13_pa4xg8vm Sep 04 19:18:14 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:15 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b7823fa6-f519-42fb-950f-6ce67c6d3c13_pa4xg8vm" returned: 0 in 0.377s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7823fa6-f519-42fb-950f-6ce67c6d3c13_pa4xg8vm {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:15 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7823fa6-f519-42fb-950f-6ce67c6d3c13_pa4xg8vm Sep 04 19:18:15 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:15 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7823fa6-f519-42fb-950f-6ce67c6d3c13_pa4xg8vm" returned: 1 in 0.369s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b7823fa6-f519-42fb-950f-6ce67c6d3c13_pa4xg8vm' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:18:15 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[226e3268-46c6-42e6-9c05-2980dc5d4c7f]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:15 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD Sep 04 19:18:15 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:15 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD" returned: 0 in 0.331s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:15 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD Sep 04 19:18:15 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:16 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:18:16 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] b7823fa6-f519-42fb-950f-6ce67c6d3c13 was raw, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 19:18:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:16 devstack sudo[101637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d Sep 04 19:18:16 devstack sudo[101637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:16 devstack sudo[101637]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d" returned: 0 in 0.488s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:16 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b7823fa6-f519-42fb-950f-6ce67c6d3c13_gss0vkmndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:18:16 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 19:18:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:16 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d 1G Sep 04 19:18:16 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:17 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d 1G" returned: 0 in 0.348s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Downloaded image b7823fa6-f519-42fb-950f-6ce67c6d3c13 ((None, [{'url': 'file:///opt/stack/data/glance/images/b7823fa6-f519-42fb-950f-6ce67c6d3c13', 'metadata': {}}])) to volume 12745721-1293-4fc2-80fb-bc8d40541e4d successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Temporary image b7823fa6-f519-42fb-950f-6ce67c6d3c13 for user 3a40fbb29ed6481b84dfb62176eaa415 is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Marking volume 12745721-1293-4fc2-80fb-bc8d40541e4d as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Copying metadata from image b7823fa6-f519-42fb-950f-6ce67c6d3c13 to 12745721-1293-4fc2-80fb-bc8d40541e4d. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Creating volume glance metadata for volume 12745721-1293-4fc2-80fb-bc8d40541e4d backed by image b7823fa6-f519-42fb-950f-6ce67c6d3c13 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b7823fa6-f519-42fb-950f-6ce67c6d3c13', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'df6688a2780b83fe2190ae2551512707', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7bf6ddc-d0bb-4d08-9b6e-89f69fb10734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12745721-1293-4fc2-80fb-bc8d40541e4d', 'volume_size': 1, 'image_id': 'b7823fa6-f519-42fb-950f-6ce67c6d3c13', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b7823fa6-f519-42fb-950f-6ce67c6d3c13', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'df6688a2780b83fe2190ae2551512707', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'be8c6da647164f008d4e5f37c4df67eb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b5ef3b8f924f3017d30ceb52816cc56d1b4b46f83634a1dd75ace6a3e5ea5b78c1eeeb93b4f39cd5e5fdc5613476854c805edc06a5b9ed5199ce8bdfc9075342', 'id': 'b7823fa6-f519-42fb-950f-6ce67c6d3c13', 'created_at': datetime.datetime(2026, 9, 4, 17, 18, 9, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 17, 18, 11, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b7823fa6-f519-42fb-950f-6ce67c6d3c13/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345fe11a-8204-48f4-9f28-d398592d4c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:17 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Volume volume-12745721-1293-4fc2-80fb-bc8d40541e4d (12745721-1293-4fc2-80fb-bc8d40541e4d): created successfully Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (345fe11a-8204-48f4-9f28-d398592d4c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Flow 'volume_create_manager' (3cc73565-8b31-41c7-8a1d-db9532663883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6a8cad3f-df9a-4730-a1ef-f491e113589c tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Created volume successfully. Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Acquiring lock "cinder-12745721-1293-4fc2-80fb-bc8d40541e4d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Lock "cinder-12745721-1293-4fc2-80fb-bc8d40541e4d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Acquiring lock "cinder-quobyte-12745721-1293-4fc2-80fb-bc8d40541e4d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Lock "cinder-quobyte-12745721-1293-4fc2-80fb-bc8d40541e4d" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a1495a-77ce-4c02-9b24-de055ad46e37]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:17 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d Sep 04 19:18:17 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:17 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d" returned: 0 in 0.365s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:18 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d Sep 04 19:18:18 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:18 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-12745721-1293-4fc2-80fb-bc8d40541e4d" returned: 0 in 0.247s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Lock "cinder-quobyte-12745721-1293-4fc2-80fb-bc8d40541e4d" released by "delete_volume" :: held 0.648s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:18 devstack cinder-volume[87560]: WARNING cinder.quota [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:18:18 devstack cinder-volume[87560]: WARNING cinder.quota [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 04 19:18:18 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Created reservations ['0e1ceba4-c1b3-4f2c-9ab9-2f579076f2ec', 'e79dbaf3-24bf-4615-9fb4-0cd19298ba9a', 'b95474e2-40fd-416e-8f45-561cc04fe1e5', 'c1920015-09f3-43b0-b0df-1324fc9ee6e1'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:18:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:18 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:18:18 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:18 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.271s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:18 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:18:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Deleted volume successfully. Sep 04 19:18:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cd591428-4a6c-4858-958a-6da89718daac tempest-VolumeAndVolumeTypeFromImageTest-27452973 None] Lock "cinder-12745721-1293-4fc2-80fb-bc8d40541e4d-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Flow 'volume_create_manager' (141ac097-5751-474a-bb4a-98a733b3aa1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84af9c5-456a-42cd-ac03-a3dd1843c044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c84af9c5-456a-42cd-ac03-a3dd1843c044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-803081609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bca191a-5104-479a-a922-f69d027700de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a8fc3112b74af88d99333b0ca8ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:23Z,use_quota=True,user_id='034581dfe6f94e6e97c14ff662d4ad82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3bdbfc-5232-4a77-abde-f3a35bd50c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be3bdbfc-5232-4a77-abde-f3a35bd50c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4854b15-0340-4f8c-8b60-2d63f452a3c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4854b15-0340-4f8c-8b60-2d63f452a3c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bca191a-5104-479a-a922-f69d027700de', 'volume_name': 'volume-8bca191a-5104-479a-a922-f69d027700de', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec08725-49cd-4414-ab29-2ddffd71635b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ec08725-49cd-4414-ab29-2ddffd71635b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ffcdbf-cdf4-4fe9-b1dd-270de43f6ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:23 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume 8bca191a-5104-479a-a922-f69d027700de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bca191a-5104-479a-a922-f69d027700de', 'volume_size': 1} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-803081609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bca191a-5104-479a-a922-f69d027700de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a8fc3112b74af88d99333b0ca8ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:23Z,use_quota=True,user_id='034581dfe6f94e6e97c14ff662d4ad82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Creating volume 8bca191a-5104-479a-a922-f69d027700de {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:18:23 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8bca191a-5104-479a-a922-f69d027700de 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:23 devstack sudo[101711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8bca191a-5104-479a-a922-f69d027700de 1073741824 Sep 04 19:18:23 devstack sudo[101711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:23 devstack sudo[101711]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8bca191a-5104-479a-a922-f69d027700de 1073741824" returned: 0 in 0.396s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8bca191a-5104-479a-a922-f69d027700de {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:24 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8bca191a-5104-479a-a922-f69d027700de Sep 04 19:18:24 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:24 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8bca191a-5104-479a-a922-f69d027700de" returned: 0 in 0.301s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:18:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4ffcdbf-cdf4-4fe9-b1dd-270de43f6ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bca191a-5104-479a-a922-f69d027700de', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6c920d-50e1-4e6b-a183-9b93478edb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume volume-8bca191a-5104-479a-a922-f69d027700de (8bca191a-5104-479a-a922-f69d027700de): created successfully Sep 04 19:18:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b6c920d-50e1-4e6b-a183-9b93478edb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Flow 'volume_create_manager' (141ac097-5751-474a-bb4a-98a733b3aa1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7d3cde43-3dff-4158-b7a6-60417139a579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Created volume successfully. Sep 04 19:18:24 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:18:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Flow 'volume_create_manager' (40beb00a-39b9-46fe-b036-a62da8a7f922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af327ad-be92-462a-a15d-ed05b5ca49bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af327ad-be92-462a-a15d-ed05b5ca49bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-479002166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9cfbce-ffba-4ec3-b406-fe243daa6839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a8fc3112b74af88d99333b0ca8ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:25Z,use_quota=True,user_id='034581dfe6f94e6e97c14ff662d4ad82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd997799-a639-4cbe-9f8a-11df8e8715ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd997799-a639-4cbe-9f8a-11df8e8715ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8acbb80-b852-482b-a9cb-f2a491a82f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8acbb80-b852-482b-a9cb-f2a491a82f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd9cfbce-ffba-4ec3-b406-fe243daa6839', 'volume_name': 'volume-cd9cfbce-ffba-4ec3-b406-fe243daa6839', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db83165-9ecd-45ec-b320-cc98682e4e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db83165-9ecd-45ec-b320-cc98682e4e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6041a1ff-365b-4e8b-bcad-6c2d4eac149d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:25 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume cd9cfbce-ffba-4ec3-b406-fe243daa6839: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd9cfbce-ffba-4ec3-b406-fe243daa6839', 'volume_size': 1} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-479002166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd9cfbce-ffba-4ec3-b406-fe243daa6839,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a8fc3112b74af88d99333b0ca8ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:25Z,use_quota=True,user_id='034581dfe6f94e6e97c14ff662d4ad82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Creating volume cd9cfbce-ffba-4ec3-b406-fe243daa6839 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:18:25 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd9cfbce-ffba-4ec3-b406-fe243daa6839 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:25 devstack sudo[101720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd9cfbce-ffba-4ec3-b406-fe243daa6839 1073741824 Sep 04 19:18:25 devstack sudo[101720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Flow 'volume_create_manager' (6a8f0146-64f0-4578-af08-16a9af889dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e7fc23-448c-424f-a6f1-7785ba955c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e7fc23-448c-424f-a6f1-7785ba955c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-804095095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26648605-455f-4fa4-8948-3f6609411ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a8fc3112b74af88d99333b0ca8ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:25Z,use_quota=True,user_id='034581dfe6f94e6e97c14ff662d4ad82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51df36a9-f423-46f7-bde1-159049e8bbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51df36a9-f423-46f7-bde1-159049e8bbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6098d967-49e3-49a6-adb7-eca704e394d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6098d967-49e3-49a6-adb7-eca704e394d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26648605-455f-4fa4-8948-3f6609411ef4', 'volume_name': 'volume-26648605-455f-4fa4-8948-3f6609411ef4', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457ccd43-0d83-4b47-8f47-f5a991ec9107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457ccd43-0d83-4b47-8f47-f5a991ec9107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a8e0e9-c292-49bc-91b1-4eb395edb8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:25 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume 26648605-455f-4fa4-8948-3f6609411ef4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26648605-455f-4fa4-8948-3f6609411ef4', 'volume_size': 1} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:25 devstack sudo[101720]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd9cfbce-ffba-4ec3-b406-fe243daa6839 1073741824" returned: 0 in 0.636s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd9cfbce-ffba-4ec3-b406-fe243daa6839 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:25 devstack sudo[101726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd9cfbce-ffba-4ec3-b406-fe243daa6839 Sep 04 19:18:25 devstack sudo[101726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Flow 'volume_create_manager' (939095b8-9c72-42c7-9967-d89ab266d8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5a4640-9ac3-4f9d-9660-dbe1324d06b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5a4640-9ac3-4f9d-9660-dbe1324d06b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1919702978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970b3304-d18e-477b-93c1-9c01d2f9c171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a8fc3112b74af88d99333b0ca8ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:26Z,use_quota=True,user_id='034581dfe6f94e6e97c14ff662d4ad82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557f71df-1d16-46f6-9d55-cbc4851415b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (557f71df-1d16-46f6-9d55-cbc4851415b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16736d1-911a-45f3-85f3-61fd60d063d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16736d1-911a-45f3-85f3-61fd60d063d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '970b3304-d18e-477b-93c1-9c01d2f9c171', 'volume_name': 'volume-970b3304-d18e-477b-93c1-9c01d2f9c171', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9776b7-ce6d-47b7-b774-28624dc5bc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e9776b7-ce6d-47b7-b774-28624dc5bc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17f2795-232e-45ae-9d65-fbbfb4a48b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:25 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume 970b3304-d18e-477b-93c1-9c01d2f9c171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-970b3304-d18e-477b-93c1-9c01d2f9c171', 'volume_size': 1} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:25 devstack sudo[101726]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd9cfbce-ffba-4ec3-b406-fe243daa6839" returned: 0 in 0.279s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.488s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-804095095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26648605-455f-4fa4-8948-3f6609411ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a8fc3112b74af88d99333b0ca8ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:25Z,use_quota=True,user_id='034581dfe6f94e6e97c14ff662d4ad82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Creating volume 26648605-455f-4fa4-8948-3f6609411ef4 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:18:26 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-26648605-455f-4fa4-8948-3f6609411ef4 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6041a1ff-365b-4e8b-bcad-6c2d4eac149d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd9cfbce-ffba-4ec3-b406-fe243daa6839', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:26 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-26648605-455f-4fa4-8948-3f6609411ef4 1073741824 Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8a4c96-f3d4-4401-a3c3-3dac16453a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:26 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:26 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume volume-cd9cfbce-ffba-4ec3-b406-fe243daa6839 (cd9cfbce-ffba-4ec3-b406-fe243daa6839): created successfully Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a8a4c96-f3d4-4401-a3c3-3dac16453a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Flow 'volume_create_manager' (40beb00a-39b9-46fe-b036-a62da8a7f922) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ba85d97c-1e36-45e4-a4f6-432d929ee2ce tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Created volume successfully. Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Flow 'volume_create_manager' (3078cc46-9ccd-4048-8f90-f4967cb00091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698494e2-1db7-4bf9-a450-d6b196ea50d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (698494e2-1db7-4bf9-a450-d6b196ea50d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-378893052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ed9671-2702-49fa-a371-15d6d51cf19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a8fc3112b74af88d99333b0ca8ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:26Z,use_quota=True,user_id='034581dfe6f94e6e97c14ff662d4ad82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f963699-3445-48c5-a741-d8d87d1a9c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f963699-3445-48c5-a741-d8d87d1a9c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dbc82cf-ef61-4969-bfbb-b1e5284223ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7dbc82cf-ef61-4969-bfbb-b1e5284223ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8ed9671-2702-49fa-a371-15d6d51cf19b', 'volume_name': 'volume-d8ed9671-2702-49fa-a371-15d6d51cf19b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c026168-a752-4763-a829-73687f07b9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c026168-a752-4763-a829-73687f07b9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21bfb17-8a26-4e49-8d26-0c18c2a30aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:26 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume d8ed9671-2702-49fa-a371-15d6d51cf19b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8ed9671-2702-49fa-a371-15d6d51cf19b', 'volume_size': 1} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:26 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-26648605-455f-4fa4-8948-3f6609411ef4 1073741824" returned: 0 in 0.512s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-26648605-455f-4fa4-8948-3f6609411ef4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:26 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-26648605-455f-4fa4-8948-3f6609411ef4 Sep 04 19:18:26 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Flow 'volume_create_manager' (3bbd3fc9-a0ae-4049-bb5e-4d25c35fbde1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8715de0e-ef3e-41f8-b60c-c28cf4200b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8715de0e-ef3e-41f8-b60c-c28cf4200b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-349075416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad99423-b74f-44a6-b6ba-1be721bb8473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a8fc3112b74af88d99333b0ca8ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:27Z,use_quota=True,user_id='034581dfe6f94e6e97c14ff662d4ad82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9aeeb0a-5b73-4088-b55e-0339a676b102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9aeeb0a-5b73-4088-b55e-0339a676b102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1da0d1-b4ba-4665-9cd8-71907b936792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1da0d1-b4ba-4665-9cd8-71907b936792) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ad99423-b74f-44a6-b6ba-1be721bb8473', 'volume_name': 'volume-8ad99423-b74f-44a6-b6ba-1be721bb8473', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bbd77a-48ec-4bda-9664-ba9819839f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59bbd77a-48ec-4bda-9664-ba9819839f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09bcddb-d981-45e5-98bf-f8ac2de3f5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:26 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume 8ad99423-b74f-44a6-b6ba-1be721bb8473: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ad99423-b74f-44a6-b6ba-1be721bb8473', 'volume_size': 1} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:26 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-26648605-455f-4fa4-8948-3f6609411ef4" returned: 0 in 0.233s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.883s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1919702978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=970b3304-d18e-477b-93c1-9c01d2f9c171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a8fc3112b74af88d99333b0ca8ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:26Z,use_quota=True,user_id='034581dfe6f94e6e97c14ff662d4ad82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Creating volume 970b3304-d18e-477b-93c1-9c01d2f9c171 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:18:26 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-970b3304-d18e-477b-93c1-9c01d2f9c171 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a8e0e9-c292-49bc-91b1-4eb395edb8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26648605-455f-4fa4-8948-3f6609411ef4', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:26 devstack sudo[101737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-970b3304-d18e-477b-93c1-9c01d2f9c171 1073741824 Sep 04 19:18:26 devstack sudo[101737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c5b5f85-a5a6-4379-a18f-10bfd6cac95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:26 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume volume-26648605-455f-4fa4-8948-3f6609411ef4 (26648605-455f-4fa4-8948-3f6609411ef4): created successfully Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c5b5f85-a5a6-4379-a18f-10bfd6cac95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Flow 'volume_create_manager' (6a8f0146-64f0-4578-af08-16a9af889dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d7a73c8d-d5aa-4813-accd-ff3be8cbb14f tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Created volume successfully. Sep 04 19:18:27 devstack sudo[101737]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-970b3304-d18e-477b-93c1-9c01d2f9c171 1073741824" returned: 0 in 0.387s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-970b3304-d18e-477b-93c1-9c01d2f9c171 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:27 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-970b3304-d18e-477b-93c1-9c01d2f9c171 Sep 04 19:18:27 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:27 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-970b3304-d18e-477b-93c1-9c01d2f9c171" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.160s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-378893052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ed9671-2702-49fa-a371-15d6d51cf19b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a8fc3112b74af88d99333b0ca8ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:26Z,use_quota=True,user_id='034581dfe6f94e6e97c14ff662d4ad82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Creating volume d8ed9671-2702-49fa-a371-15d6d51cf19b {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:18:27 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ed9671-2702-49fa-a371-15d6d51cf19b 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17f2795-232e-45ae-9d65-fbbfb4a48b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-970b3304-d18e-477b-93c1-9c01d2f9c171', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:27 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ed9671-2702-49fa-a371-15d6d51cf19b 1073741824 Sep 04 19:18:27 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51d2a0c-3d4f-432f-944e-a5eb860a6b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:27 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume volume-970b3304-d18e-477b-93c1-9c01d2f9c171 (970b3304-d18e-477b-93c1-9c01d2f9c171): created successfully Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51d2a0c-3d4f-432f-944e-a5eb860a6b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Flow 'volume_create_manager' (939095b8-9c72-42c7-9967-d89ab266d8b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:27 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-07f83c84-0e08-45ff-96f1-4b4f8b617229 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Created volume successfully. Sep 04 19:18:27 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ed9671-2702-49fa-a371-15d6d51cf19b 1073741824" returned: 0 in 0.408s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ed9671-2702-49fa-a371-15d6d51cf19b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:27 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ed9671-2702-49fa-a371-15d6d51cf19b Sep 04 19:18:27 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:28 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ed9671-2702-49fa-a371-15d6d51cf19b" returned: 0 in 0.238s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.509s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-349075416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad99423-b74f-44a6-b6ba-1be721bb8473,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13a8fc3112b74af88d99333b0ca8ed6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:27Z,use_quota=True,user_id='034581dfe6f94e6e97c14ff662d4ad82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Creating volume 8ad99423-b74f-44a6-b6ba-1be721bb8473 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:18:28 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8ad99423-b74f-44a6-b6ba-1be721bb8473 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21bfb17-8a26-4e49-8d26-0c18c2a30aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ed9671-2702-49fa-a371-15d6d51cf19b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:28 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8ad99423-b74f-44a6-b6ba-1be721bb8473 1073741824 Sep 04 19:18:28 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcccd2d3-74e0-48ce-b188-4de538ef2980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:28 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume volume-d8ed9671-2702-49fa-a371-15d6d51cf19b (d8ed9671-2702-49fa-a371-15d6d51cf19b): created successfully Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcccd2d3-74e0-48ce-b188-4de538ef2980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Flow 'volume_create_manager' (3078cc46-9ccd-4048-8f90-f4967cb00091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d7e6cbe9-382c-4e83-8568-5be73454c794 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Created volume successfully. Sep 04 19:18:28 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8ad99423-b74f-44a6-b6ba-1be721bb8473 1073741824" returned: 0 in 0.447s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8ad99423-b74f-44a6-b6ba-1be721bb8473 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:28 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8ad99423-b74f-44a6-b6ba-1be721bb8473 Sep 04 19:18:28 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Flow 'volume_create_manager' (f2ead183-8ef3-41bb-9b79-8abc9aa1fc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:28 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f85577e-8e5e-408c-af94-5dc3d4e6517d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8ad99423-b74f-44a6-b6ba-1be721bb8473" returned: 0 in 0.264s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f85577e-8e5e-408c-af94-5dc3d4e6517d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-259861241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928ac655-0df8-427d-b671-6d7027ea2176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b95f271d2a74d02857a879159933aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:29Z,use_quota=True,user_id='4e5ef04f4cc84e708a1531c528fb62b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b520e9ba-b8ad-4e24-b0fc-f652a66809dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b520e9ba-b8ad-4e24-b0fc-f652a66809dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c782a0df-5f9b-48f9-ac93-48316a3e6f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c782a0df-5f9b-48f9-ac93-48316a3e6f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '928ac655-0df8-427d-b671-6d7027ea2176', 'volume_name': 'volume-928ac655-0df8-427d-b671-6d7027ea2176', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c38125f-a8b3-4e71-94e7-25a1eabc81e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c38125f-a8b3-4e71-94e7-25a1eabc81e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d57cad-76a1-4b00-94bc-faa5a1e8a955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:28 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Volume 928ac655-0df8-427d-b671-6d7027ea2176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-928ac655-0df8-427d-b671-6d7027ea2176', 'volume_size': 1} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-259861241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=928ac655-0df8-427d-b671-6d7027ea2176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b95f271d2a74d02857a879159933aee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:29Z,use_quota=True,user_id='4e5ef04f4cc84e708a1531c528fb62b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Creating volume 928ac655-0df8-427d-b671-6d7027ea2176 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:18:28 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:18:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-928ac655-0df8-427d-b671-6d7027ea2176 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09bcddb-d981-45e5-98bf-f8ac2de3f5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad99423-b74f-44a6-b6ba-1be721bb8473', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a5fede-a32b-4b99-a1b7-7e3d1d03f16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:29 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-928ac655-0df8-427d-b671-6d7027ea2176 1073741824 Sep 04 19:18:29 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:29 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Volume volume-8ad99423-b74f-44a6-b6ba-1be721bb8473 (8ad99423-b74f-44a6-b6ba-1be721bb8473): created successfully Sep 04 19:18:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a5fede-a32b-4b99-a1b7-7e3d1d03f16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Flow 'volume_create_manager' (3bbd3fc9-a0ae-4049-bb5e-4d25c35fbde1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1cf94f5d-e883-43f4-b58f-13b4303c4579 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Created volume successfully. Sep 04 19:18:29 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-928ac655-0df8-427d-b671-6d7027ea2176 1073741824" returned: 0 in 0.462s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-928ac655-0df8-427d-b671-6d7027ea2176 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:29 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-928ac655-0df8-427d-b671-6d7027ea2176 Sep 04 19:18:29 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:29 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-928ac655-0df8-427d-b671-6d7027ea2176" returned: 0 in 0.238s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:18:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07d57cad-76a1-4b00-94bc-faa5a1e8a955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-928ac655-0df8-427d-b671-6d7027ea2176', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffe3d67-fa55-4a89-90bd-41ff2e104305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:29 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Volume volume-928ac655-0df8-427d-b671-6d7027ea2176 (928ac655-0df8-427d-b671-6d7027ea2176): created successfully Sep 04 19:18:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bffe3d67-fa55-4a89-90bd-41ff2e104305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Flow 'volume_create_manager' (f2ead183-8ef3-41bb-9b79-8abc9aa1fc9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b7028b89-5e64-46a0-ab9a-fc416d240b40 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Created volume successfully. Sep 04 19:18:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "cinder-8ad99423-b74f-44a6-b6ba-1be721bb8473-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-8ad99423-b74f-44a6-b6ba-1be721bb8473-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "cinder-quobyte-8ad99423-b74f-44a6-b6ba-1be721bb8473" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-quobyte-8ad99423-b74f-44a6-b6ba-1be721bb8473" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[084489a8-0d5e-44d0-9ab1-aa6cd8d24072]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8ad99423-b74f-44a6-b6ba-1be721bb8473 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:30 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8ad99423-b74f-44a6-b6ba-1be721bb8473 Sep 04 19:18:30 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:30 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8ad99423-b74f-44a6-b6ba-1be721bb8473" returned: 0 in 0.468s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8ad99423-b74f-44a6-b6ba-1be721bb8473 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:30 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8ad99423-b74f-44a6-b6ba-1be721bb8473 Sep 04 19:18:30 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-0ed98daf-21ae-4bfe-bb71-a4c2e76d9230 req-2929b937-7470-4f43-85c3-30a0a518d77e tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-0ed98daf-21ae-4bfe-bb71-a4c2e76d9230 req-2929b937-7470-4f43-85c3-30a0a518d77e tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-0ed98daf-21ae-4bfe-bb71-a4c2e76d9230 req-2929b937-7470-4f43-85c3-30a0a518d77e tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-0ed98daf-21ae-4bfe-bb71-a4c2e76d9230 req-2929b937-7470-4f43-85c3-30a0a518d77e tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-928ac655-0df8-427d-b671-6d7027ea2176', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77338c44-273c-403b-b2e0-f048971d8a9b', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:18:30 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8ad99423-b74f-44a6-b6ba-1be721bb8473" returned: 0 in 0.287s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-quobyte-8ad99423-b74f-44a6-b6ba-1be721bb8473" released by "delete_volume" :: held 0.819s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-0ed98daf-21ae-4bfe-bb71-a4c2e76d9230 req-2929b937-7470-4f43-85c3-30a0a518d77e tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] attachment_update completed successfully. Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Created reservations ['a34cf620-60f7-4f0a-aed0-b697d71f3fda', 'ae44eff2-e97d-409f-8a60-b72aabb287fb', '62dccfb0-83f3-47a8-99c0-5487501ed72c', 'f89b1019-932e-4d29-8895-d98110f3a8c6'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:31 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:18:31 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "cinder-d8ed9671-2702-49fa-a371-15d6d51cf19b-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-d8ed9671-2702-49fa-a371-15d6d51cf19b-delete_volume" acquired by "delete_volume" :: waited 0.125s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "cinder-quobyte-d8ed9671-2702-49fa-a371-15d6d51cf19b" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-quobyte-d8ed9671-2702-49fa-a371-15d6d51cf19b" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:31 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[756a1dff-dd3a-4dce-ab3f-dc7a0f36378d]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ed9671-2702-49fa-a371-15d6d51cf19b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:31 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.640s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:31 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:18:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Deleted volume successfully. Sep 04 19:18:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-243d3329-fcd8-4642-9c05-85365c654667 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-8ad99423-b74f-44a6-b6ba-1be721bb8473-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:31 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ed9671-2702-49fa-a371-15d6d51cf19b Sep 04 19:18:31 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:32 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ed9671-2702-49fa-a371-15d6d51cf19b" returned: 0 in 0.514s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ed9671-2702-49fa-a371-15d6d51cf19b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:32 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ed9671-2702-49fa-a371-15d6d51cf19b Sep 04 19:18:32 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:32 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ed9671-2702-49fa-a371-15d6d51cf19b" returned: 0 in 0.248s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-quobyte-d8ed9671-2702-49fa-a371-15d6d51cf19b" released by "delete_volume" :: held 0.841s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Created reservations ['c02a344e-68f5-44fe-acae-85d51df17540', '99423da1-cbe3-4524-bdfe-4919ed0dacea', '0e80a0f0-cdea-47b9-83fb-b2f03d27de8c', 'f4d38142-c4c0-4c4b-9196-28148de978e7'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:32 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:18:32 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "cinder-970b3304-d18e-477b-93c1-9c01d2f9c171-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-970b3304-d18e-477b-93c1-9c01d2f9c171-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "cinder-quobyte-970b3304-d18e-477b-93c1-9c01d2f9c171" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-quobyte-970b3304-d18e-477b-93c1-9c01d2f9c171" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d01d5f9-5bbd-40b5-a2af-282e700e75be]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-970b3304-d18e-477b-93c1-9c01d2f9c171 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:32 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.285s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:18:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Deleted volume successfully. Sep 04 19:18:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-9d9ad99d-ace2-486e-956d-e47053d95734 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-d8ed9671-2702-49fa-a371-15d6d51cf19b-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:32 devstack sudo[101869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-970b3304-d18e-477b-93c1-9c01d2f9c171 Sep 04 19:18:32 devstack sudo[101869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:33 devstack sudo[101869]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-970b3304-d18e-477b-93c1-9c01d2f9c171" returned: 0 in 0.423s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-970b3304-d18e-477b-93c1-9c01d2f9c171 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:33 devstack sudo[101875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-970b3304-d18e-477b-93c1-9c01d2f9c171 Sep 04 19:18:33 devstack sudo[101875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:33 devstack sudo[101875]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-970b3304-d18e-477b-93c1-9c01d2f9c171" returned: 0 in 0.328s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-quobyte-970b3304-d18e-477b-93c1-9c01d2f9c171" released by "delete_volume" :: held 0.845s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:33 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Created reservations ['ed4cd736-b601-4fa8-a7fc-944cf5d37f97', '288b4673-a6bc-454c-98a5-bbbd5af48538', 'fe646307-54fa-4aa4-95df-899619d75724', '7f2ddb2e-de89-4816-9f59-0be522f64d32'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:18:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:33 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:18:33 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "cinder-26648605-455f-4fa4-8948-3f6609411ef4-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-26648605-455f-4fa4-8948-3f6609411ef4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-a5e21338-5808-405d-b3d8-61250b2cda83 req-b59a0ecc-6480-4f50-a957-72ee6e5a5374 tempest-TestShelveInstance-1095350994 None] Terminate volume connection completed successfully. Sep 04 19:18:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-a5e21338-5808-405d-b3d8-61250b2cda83 req-b59a0ecc-6480-4f50-a957-72ee6e5a5374 tempest-TestShelveInstance-1095350994 None] Deleting attachment 6cdc989f-24d4-4aee-8c30-a381ca9c356f. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:18:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "cinder-quobyte-26648605-455f-4fa4-8948-3f6609411ef4" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:34 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.331s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:34 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:18:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-quobyte-26648605-455f-4fa4-8948-3f6609411ef4" acquired by "delete_volume" :: waited 0.039s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Deleted volume successfully. Sep 04 19:18:34 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef9d8a4-b868-446d-a8a2-38d92fdaad7b]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-26648605-455f-4fa4-8948-3f6609411ef4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-71feb2c7-b833-4dda-9be6-17555b188ebe tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-970b3304-d18e-477b-93c1-9c01d2f9c171-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:34 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-26648605-455f-4fa4-8948-3f6609411ef4 Sep 04 19:18:34 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-6b60e707-c645-4530-adba-529105e8e427 req-b2779f80-3468-4967-afed-080ac504e2a5 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Terminate volume connection completed successfully. Sep 04 19:18:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-6b60e707-c645-4530-adba-529105e8e427 req-b2779f80-3468-4967-afed-080ac504e2a5 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Deleting attachment 77338c44-273c-403b-b2e0-f048971d8a9b. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:18:34 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-26648605-455f-4fa4-8948-3f6609411ef4" returned: 0 in 0.478s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-26648605-455f-4fa4-8948-3f6609411ef4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:34 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-26648605-455f-4fa4-8948-3f6609411ef4 Sep 04 19:18:34 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:34 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-26648605-455f-4fa4-8948-3f6609411ef4" returned: 0 in 0.263s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-quobyte-26648605-455f-4fa4-8948-3f6609411ef4" released by "delete_volume" :: held 0.787s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:34 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Created reservations ['13a0fe5e-8743-4d09-b697-095b5e31f967', 'd2b64fab-00ba-4888-a2f4-9bb9e46590d4', 'aa3539e4-0929-49f0-831f-e8da4f6d1956', '5c2fbb0a-f66e-42ca-ac18-56f374b1140e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:35 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:18:35 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "cinder-cd9cfbce-ffba-4ec3-b406-fe243daa6839-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Acquiring lock "cinder-928ac655-0df8-427d-b671-6d7027ea2176-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-cd9cfbce-ffba-4ec3-b406-fe243daa6839-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Lock "cinder-928ac655-0df8-427d-b671-6d7027ea2176-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "cinder-quobyte-cd9cfbce-ffba-4ec3-b406-fe243daa6839" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Acquiring lock "cinder-quobyte-928ac655-0df8-427d-b671-6d7027ea2176" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-quobyte-cd9cfbce-ffba-4ec3-b406-fe243daa6839" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Lock "cinder-quobyte-928ac655-0df8-427d-b671-6d7027ea2176" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:35 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b630ac-5abd-4d5b-a86a-e43f93da767e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd9cfbce-ffba-4ec3-b406-fe243daa6839 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[740b53ce-1769-404c-b5d3-7854f1965522]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-928ac655-0df8-427d-b671-6d7027ea2176 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.359s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:18:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Deleted volume successfully. Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-69e3dd9b-a763-4750-a811-5199b7a45804 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-26648605-455f-4fa4-8948-3f6609411ef4-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:35 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd9cfbce-ffba-4ec3-b406-fe243daa6839 Sep 04 19:18:35 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:35 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-928ac655-0df8-427d-b671-6d7027ea2176 Sep 04 19:18:35 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:35 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd9cfbce-ffba-4ec3-b406-fe243daa6839" returned: 0 in 0.413s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd9cfbce-ffba-4ec3-b406-fe243daa6839 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:35 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-928ac655-0df8-427d-b671-6d7027ea2176" returned: 0 in 0.407s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-928ac655-0df8-427d-b671-6d7027ea2176 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:35 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd9cfbce-ffba-4ec3-b406-fe243daa6839 Sep 04 19:18:35 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:35 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-928ac655-0df8-427d-b671-6d7027ea2176 Sep 04 19:18:35 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:36 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd9cfbce-ffba-4ec3-b406-fe243daa6839" returned: 0 in 0.294s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-quobyte-cd9cfbce-ffba-4ec3-b406-fe243daa6839" released by "delete_volume" :: held 0.776s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:36 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-928ac655-0df8-427d-b671-6d7027ea2176" returned: 0 in 0.325s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Lock "cinder-quobyte-928ac655-0df8-427d-b671-6d7027ea2176" released by "delete_volume" :: held 0.788s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Created reservations ['6c93b1ef-8fa2-40f0-ba6a-1027a934c281', 'e9e3f9eb-706a-42eb-bf77-5e1eadf98643', 'b1941568-0601-46c3-a70c-f63a4a721973', '8cb3e909-5e04-4762-aaac-db9e4eddad53'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Created reservations ['838212ec-716f-4bb2-9f0e-40f44540eff0', '5114c596-c1ba-4b6e-bcd4-4b39b7b29e7e', 'f6907c47-0efd-4c80-b59b-8df8708de50c', 'f495eb0c-a910-4149-8d4a-1bd4cd42c91f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:36 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:18:36 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:36 devstack sudo[101934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:18:36 devstack sudo[101934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "cinder-8bca191a-5104-479a-a922-f69d027700de-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-8bca191a-5104-479a-a922-f69d027700de-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "cinder-quobyte-8bca191a-5104-479a-a922-f69d027700de" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-quobyte-8bca191a-5104-479a-a922-f69d027700de" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2115e03d-b9bd-4258-8298-1ef8673a94d6]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8bca191a-5104-479a-a922-f69d027700de {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:36 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.418s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:18:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Deleted volume successfully. Sep 04 19:18:36 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8bca191a-5104-479a-a922-f69d027700de Sep 04 19:18:36 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-17c81a51-2676-4ccf-9fc2-35ef999b2415 tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-cd9cfbce-ffba-4ec3-b406-fe243daa6839-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:36 devstack sudo[101934]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.474s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:18:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Deleted volume successfully. Sep 04 19:18:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5a5bc8f7-4a1b-4f35-a170-046092d19dc4 tempest-TestServerVolumeAttachScenarioOldVersion-1737337321 None] Lock "cinder-928ac655-0df8-427d-b671-6d7027ea2176-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:37 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8bca191a-5104-479a-a922-f69d027700de" returned: 0 in 0.642s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8bca191a-5104-479a-a922-f69d027700de {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:37 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8bca191a-5104-479a-a922-f69d027700de Sep 04 19:18:37 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:37 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8bca191a-5104-479a-a922-f69d027700de" returned: 0 in 0.321s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-quobyte-8bca191a-5104-479a-a922-f69d027700de" released by "delete_volume" :: held 1.039s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:37 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Created reservations ['7bf068bb-6781-455a-97ef-e0bc39e81f7b', 'fcf25133-8ee5-4259-b27e-3a5865ccab68', '08dbfb33-a836-4c64-8dab-1f98a732061e', '09c1929b-47ac-4071-b001-82ae129ede70'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:18:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:37 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:18:37 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-41451d2c-0033-442e-bdb9-88dbfcb980b2 req-2ad4d5ac-8b77-46e7-98f7-8a3a62c56679 tempest-TestShelveInstance-1095350994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-41451d2c-0033-442e-bdb9-88dbfcb980b2 req-2ad4d5ac-8b77-46e7-98f7-8a3a62c56679 tempest-TestShelveInstance-1095350994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-41451d2c-0033-442e-bdb9-88dbfcb980b2 req-2ad4d5ac-8b77-46e7-98f7-8a3a62c56679 tempest-TestShelveInstance-1095350994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-41451d2c-0033-442e-bdb9-88dbfcb980b2 req-2ad4d5ac-8b77-46e7-98f7-8a3a62c56679 tempest-TestShelveInstance-1095350994 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-d8091bf3-65cc-49be-baff-6e4c80202d4e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f55ee006-fa44-42e0-972d-fe0f0d1f1205', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:18:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-41451d2c-0033-442e-bdb9-88dbfcb980b2 req-2ad4d5ac-8b77-46e7-98f7-8a3a62c56679 tempest-TestShelveInstance-1095350994 None] attachment_update completed successfully. Sep 04 19:18:38 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.322s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:38 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:18:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Deleted volume successfully. Sep 04 19:18:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d65dd53f-0afb-41ae-a064-2f8e4f7da9fb tempest-CreateVolumesFromSourceVolumeTest-2021520934 None] Lock "cinder-8bca191a-5104-479a-a922-f69d027700de-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Flow 'volume_create_manager' (10e1ad75-00ea-4698-99da-e17ed418f5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464d0b5f-5d89-4477-a53a-0ad9a8a5757f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (464d0b5f-5d89-4477-a53a-0ad9a8a5757f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1301821064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0fcca53-d62b-4205-a1b4-9aea5efb7e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6988aef0b2f74ad0a86b4b307cc103c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:43Z,use_quota=True,user_id='3fc8fa0b74604e4abd086db66aaaeaaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920b58d8-99db-4dbf-ae56-fe731da22d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920b58d8-99db-4dbf-ae56-fe731da22d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85b5f78-f581-4cc8-82bc-a34d56570308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85b5f78-f581-4cc8-82bc-a34d56570308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0fcca53-d62b-4205-a1b4-9aea5efb7e37', 'volume_name': 'volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8796570f-1dd8-4416-9e60-8e8f17c8e44c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8796570f-1dd8-4416-9e60-8e8f17c8e44c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52bbf9d-85f7-4340-b1ea-9d597e5df870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:43 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Volume f0fcca53-d62b-4205-a1b4-9aea5efb7e37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37', 'volume_size': 1} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1301821064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0fcca53-d62b-4205-a1b4-9aea5efb7e37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6988aef0b2f74ad0a86b4b307cc103c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:43Z,use_quota=True,user_id='3fc8fa0b74604e4abd086db66aaaeaaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Creating volume f0fcca53-d62b-4205-a1b4-9aea5efb7e37 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:18:43 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:43 devstack sudo[102430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 1073741824 Sep 04 19:18:43 devstack sudo[102430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:43 devstack sudo[102430]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 1073741824" returned: 0 in 0.675s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:44 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 Sep 04 19:18:44 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:44 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:18:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52bbf9d-85f7-4340-b1ea-9d597e5df870) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1208d3e7-ce9d-49fe-ae22-32e9dceb8a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:44 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Volume volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 (f0fcca53-d62b-4205-a1b4-9aea5efb7e37): created successfully Sep 04 19:18:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1208d3e7-ce9d-49fe-ae22-32e9dceb8a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Flow 'volume_create_manager' (10e1ad75-00ea-4698-99da-e17ed418f5d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3a4dd7b5-734e-429b-b17c-a67fe116350f tempest-VolumeDependencyTests-1941719653 None] Created volume successfully. Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:45 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:18:45 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] Creating offline snapshot b91440ae-3bf0-4c59-ac31-22ffc4f5b679 of volume f0fcca53-d62b-4205-a1b4-9aea5efb7e37 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cea18ac-c173-47ad-962f-0284e3e956b3]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:45 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.350s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:18:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:18:45 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 Sep 04 19:18:45 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:46 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37" returned: 0 in 0.552s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:46 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 1G Sep 04 19:18:46 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:46 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 1G" returned: 0 in 0.468s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:46 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 Sep 04 19:18:46 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:46 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679" returned: 0 in 0.384s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:46 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 is being set with open permissions: ugo+rw Sep 04 19:18:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:46 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 Sep 04 19:18:46 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:47 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679" returned: 0 in 0.287s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:47 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.info Sep 04 19:18:47 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:47 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.info" returned: 0 in 0.294s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:47 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.info is being set with open permissions: ugo+rw Sep 04 19:18:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:47 devstack sudo[102469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.info Sep 04 19:18:47 devstack sudo[102469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:47 devstack sudo[102469]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.info" returned: 0 in 0.273s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.369s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-6b1a00e8-67d0-4dca-a7cb-a47487d205cf tempest-VolumeDependencyTests-1941719653 None] Create snapshot completed successfully Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Flow 'volume_create_manager' (ba3ef1c2-67e5-41a2-b7c6-d209169e702d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1be2ae1-531b-4633-a072-adaeda9d6c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1be2ae1-531b-4633-a072-adaeda9d6c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1002514652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5885a34-28b4-48d4-bffb-2b26673ae62c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6988aef0b2f74ad0a86b4b307cc103c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:18:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b91440ae-3bf0-4c59-ac31-22ffc4f5b679,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:18:49Z,use_quota=True,user_id='3fc8fa0b74604e4abd086db66aaaeaaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44bfe0be-bae1-403f-997c-ded5f996fbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44bfe0be-bae1-403f-997c-ded5f996fbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9335534e-0b07-4a20-8841-ea775548cd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9335534e-0b07-4a20-8841-ea775548cd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b5885a34-28b4-48d4-bffb-2b26673ae62c', 'volume_name': 'volume-b5885a34-28b4-48d4-bffb-2b26673ae62c', 'volume_size': 1, 'snapshot_id': 'b91440ae-3bf0-4c59-ac31-22ffc4f5b679'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0d51bc-a6fb-4a8b-b571-4b478c7d147f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce0d51bc-a6fb-4a8b-b571-4b478c7d147f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533ce67f-7975-4148-98ea-0929a494d1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:49 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Volume b5885a34-28b4-48d4-bffb-2b26673ae62c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b5885a34-28b4-48d4-bffb-2b26673ae62c', 'volume_size': 1, 'snapshot_id': 'b91440ae-3bf0-4c59-ac31-22ffc4f5b679'} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "cinder-quobyte-b91440ae-3bf0-4c59-ac31-22ffc4f5b679-b5885a34-28b4-48d4-bffb-2b26673ae62c" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-quobyte-b91440ae-3bf0-4c59-ac31-22ffc4f5b679-b5885a34-28b4-48d4-bffb-2b26673ae62c" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Creating volume b5885a34-28b4-48d4-bffb-2b26673ae62c from snapshot b91440ae-3bf0-4c59-ac31-22ffc4f5b679 {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "cinder-quobyte-b5885a34-28b4-48d4-bffb-2b26673ae62c" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-quobyte-b5885a34-28b4-48d4-bffb-2b26673ae62c" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] snapshot: b91440ae-3bf0-4c59-ac31-22ffc4f5b679, volume: b5885a34-28b4-48d4-bffb-2b26673ae62c, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6260bb40-a56f-4b76-befe-0327fc39cf5a]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:49 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 Sep 04 19:18:49 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:49 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679" returned: 0 in 0.389s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[40142e69-65c4-4e2d-a784-6929f6efa2da]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:49 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 Sep 04 19:18:49 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:50 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37" returned: 0 in 0.364s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 19:18:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 19:18:50 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Path /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b5885a34-28b4-48d4-bffb-2b26673ae62c not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 19:18:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b5885a34-28b4-48d4-bffb-2b26673ae62c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:50 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b5885a34-28b4-48d4-bffb-2b26673ae62c Sep 04 19:18:50 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:55 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b5885a34-28b4-48d4-bffb-2b26673ae62c" returned: 0 in 5.640s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:55 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b5885a34-28b4-48d4-bffb-2b26673ae62c {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:18:55 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Converted 1024.00 MB image at 181.51 MB/s Sep 04 19:18:55 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b5885a34-28b4-48d4-bffb-2b26673ae62c is being set with open permissions: ugo+rw Sep 04 19:18:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b5885a34-28b4-48d4-bffb-2b26673ae62c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:55 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b5885a34-28b4-48d4-bffb-2b26673ae62c Sep 04 19:18:55 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:56 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b5885a34-28b4-48d4-bffb-2b26673ae62c" returned: 0 in 0.258s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-quobyte-b5885a34-28b4-48d4-bffb-2b26673ae62c" released by "_copy_volume_from_snapshot" :: held 6.730s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-quobyte-b91440ae-3bf0-4c59-ac31-22ffc4f5b679-b5885a34-28b4-48d4-bffb-2b26673ae62c" released by "_create_volume_from_snapshot" :: held 6.795s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.814s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:18:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (533ce67f-7975-4148-98ea-0929a494d1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5885a34-28b4-48d4-bffb-2b26673ae62c', 'volume_size': 1, 'snapshot_id': 'b91440ae-3bf0-4c59-ac31-22ffc4f5b679'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ff0146-d185-4f74-990f-c691450e3798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:18:56 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Volume volume-b5885a34-28b4-48d4-bffb-2b26673ae62c (b5885a34-28b4-48d4-bffb-2b26673ae62c): created successfully Sep 04 19:18:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46ff0146-d185-4f74-990f-c691450e3798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:18:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Flow 'volume_create_manager' (ba3ef1c2-67e5-41a2-b7c6-d209169e702d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:18:56 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f6e5b5bc-d8be-4d27-a0fc-a848b585d7fe tempest-VolumeDependencyTests-1941719653 None] Created volume successfully. Sep 04 19:18:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "cinder-b91440ae-3bf0-4c59-ac31-22ffc4f5b679-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-b91440ae-3bf0-4c59-ac31-22ffc4f5b679-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "cinder-quobyte-f0fcca53-d62b-4205-a1b4-9aea5efb7e37" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-quobyte-f0fcca53-d62b-4205-a1b4-9aea5efb7e37" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "cinder-quobyte-b91440ae-3bf0-4c59-ac31-22ffc4f5b679" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-quobyte-b91440ae-3bf0-4c59-ac31-22ffc4f5b679" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Deleting offline snapshot b91440ae-3bf0-4c59-ac31-22ffc4f5b679 of volume f0fcca53-d62b-4205-a1b4-9aea5efb7e37 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:18:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] snapshot_file for this snap is: volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:18:57 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d0886e-bbc5-4d59-bbf6-433d6a71f1d5]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:57 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 Sep 04 19:18:57 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:57 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679" returned: 0 in 0.404s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:18:57 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21a7e26-902a-4385-81a6-d8fe7a8371bc]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:57 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 Sep 04 19:18:57 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:58 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37" returned: 0 in 0.708s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:58 devstack sudo[102521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 Sep 04 19:18:58 devstack sudo[102521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:58 devstack sudo[102521]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679" returned: 0 in 0.355s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:58 devstack sudo[102526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679 Sep 04 19:18:58 devstack sudo[102526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:59 devstack sudo[102526]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37.b91440ae-3bf0-4c59-ac31-22ffc4f5b679" returned: 0 in 0.267s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-quobyte-b91440ae-3bf0-4c59-ac31-22ffc4f5b679" released by "_delete_snapshot" :: held 1.858s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-quobyte-f0fcca53-d62b-4205-a1b4-9aea5efb7e37" released by "delete_snapshot" :: held 1.900s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:59 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Created reservations ['50a15169-ab5e-406a-9a5c-c1c04d55952a', '346080fa-4d81-452a-a463-60fac43224af', '71b3aa9f-cca0-4d6a-bd64-95a0bf36d1c8', '7a7d3503-a6b9-4732-b7fc-a7400e2f2a65'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:18:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Delete snapshot completed successfully. Sep 04 19:18:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e18c93d3-c78e-46e7-89a4-810209555836 tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-b91440ae-3bf0-4c59-ac31-22ffc4f5b679-delete_snapshot" released by "delete_snapshot" :: held 2.119s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:18:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "cinder-f0fcca53-d62b-4205-a1b4-9aea5efb7e37-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-f0fcca53-d62b-4205-a1b4-9aea5efb7e37-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "cinder-quobyte-f0fcca53-d62b-4205-a1b4-9aea5efb7e37" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:18:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-quobyte-f0fcca53-d62b-4205-a1b4-9aea5efb7e37" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:18:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[435e4b38-ca70-4b73-bb22-3923eab01028]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:18:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:59 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 Sep 04 19:18:59 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:18:59 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Sep 04 19:18:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37" returned: 0 in 0.394s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:18:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:18:59 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37 Sep 04 19:18:59 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:00 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f0fcca53-d62b-4205-a1b4-9aea5efb7e37" returned: 0 in 0.260s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-quobyte-f0fcca53-d62b-4205-a1b4-9aea5efb7e37" released by "delete_volume" :: held 0.746s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Created reservations ['33ed862c-37aa-4d39-8166-f08d79bd9a97', 'a4224d5f-f031-4ba6-8ad7-39dec67163cd', 'ee1ed4be-73e3-4075-bfbe-b386ff720f3c', '3751ca73-62c6-42b9-b590-95c0b0cf1b2f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:00 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:19:00 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "cinder-b5885a34-28b4-48d4-bffb-2b26673ae62c-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-b5885a34-28b4-48d4-bffb-2b26673ae62c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:00 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.268s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "cinder-quobyte-b5885a34-28b4-48d4-bffb-2b26673ae62c" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Deleted volume successfully. Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-quobyte-b5885a34-28b4-48d4-bffb-2b26673ae62c" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e9b31758-4220-4bb2-9c09-c1f49ea549e1 tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-f0fcca53-d62b-4205-a1b4-9aea5efb7e37-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3f683c-fc39-4f92-aefb-f96dbf11fa6e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:19:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b5885a34-28b4-48d4-bffb-2b26673ae62c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:00 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b5885a34-28b4-48d4-bffb-2b26673ae62c Sep 04 19:19:00 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:01 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b5885a34-28b4-48d4-bffb-2b26673ae62c" returned: 0 in 0.394s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b5885a34-28b4-48d4-bffb-2b26673ae62c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:01 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b5885a34-28b4-48d4-bffb-2b26673ae62c Sep 04 19:19:01 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:01 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b5885a34-28b4-48d4-bffb-2b26673ae62c" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-quobyte-b5885a34-28b4-48d4-bffb-2b26673ae62c" released by "delete_volume" :: held 0.709s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:01 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Created reservations ['19b57c4d-e83d-4d6e-9dfb-f56fc4dc8df5', '507e3c56-c51a-4ace-8206-3dea1963ec97', '56311c52-f9c6-4da3-805f-4daa04960b07', '7cc3e748-3bfc-4537-825d-338c0c170f7e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:19:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:19:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:19:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:01 devstack sudo[102576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:19:01 devstack sudo[102576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:01 devstack sudo[102576]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.264s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:01 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:19:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Deleted volume successfully. Sep 04 19:19:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bd3fa35d-d77c-4ab9-8f86-083367bef713 tempest-VolumeDependencyTests-1941719653 None] Lock "cinder-b5885a34-28b4-48d4-bffb-2b26673ae62c-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Flow 'volume_create_manager' (ec0ab5fc-5f2a-4d2f-94d5-f98ae9ef5d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6086798-5c74-4b7e-9428-10fe3cae40fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6086798-5c74-4b7e-9428-10fe3cae40fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1628216572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700398e5d7f54cd79c5095ae63a4ea61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:19:06Z,use_quota=True,user_id='633ef8f2267d4a289765da8e660322a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a2ff88-426f-466b-af7b-f40406fd775b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58a2ff88-426f-466b-af7b-f40406fd775b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8b31de-2a58-4b81-a5f2-049e1810e13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba8b31de-2a58-4b81-a5f2-049e1810e13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc', 'volume_name': 'volume-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (877444c3-afcf-4fea-ba42-1a494234b66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (877444c3-afcf-4fea-ba42-1a494234b66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9278564e-29be-40c3-89cb-a03f07af435a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:05 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Volume 2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc', 'volume_size': 1} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:19:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1628216572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700398e5d7f54cd79c5095ae63a4ea61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:19:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:19:06Z,use_quota=True,user_id='633ef8f2267d4a289765da8e660322a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Creating volume 2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:19:05 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:19:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:05 devstack sudo[102581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc 1073741824 Sep 04 19:19:05 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:06 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc 1073741824" returned: 0 in 0.609s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:06 devstack sudo[102587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc Sep 04 19:19:06 devstack sudo[102587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:06 devstack sudo[102587]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc" returned: 0 in 0.274s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:19:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9278564e-29be-40c3-89cb-a03f07af435a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201c764d-4d12-4318-a5ba-33be48d3733d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:06 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Volume volume-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc (2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc): created successfully Sep 04 19:19:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (201c764d-4d12-4318-a5ba-33be48d3733d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Flow 'volume_create_manager' (ec0ab5fc-5f2a-4d2f-94d5-f98ae9ef5d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:19:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-282d12a7-5efc-4776-9d0c-c7269c408418 tempest-ProjectReaderTests-682714229 None] Created volume successfully. Sep 04 19:19:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Acquiring lock "cinder-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Lock "cinder-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:07 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=94,cinder:UPDATE=132,cinder:INSERT=38,cinder:DELETE=9 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:19:08 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=115,cinder:INSERT=28,cinder:UPDATE=119,cinder:DELETE=13 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:19:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Acquiring lock "cinder-quobyte-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Lock "cinder-quobyte-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:08 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6003ef5e-c1ad-4cc8-95a3-d4281e57c45e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:19:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:08 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc Sep 04 19:19:08 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:08 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc" returned: 0 in 0.373s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:08 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc Sep 04 19:19:08 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:08 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc" returned: 0 in 0.260s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Lock "cinder-quobyte-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc" released by "delete_volume" :: held 0.676s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:08 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Created reservations ['1c9c77d5-84b0-4bb4-99ed-c1ec0158f83f', 'c2092f50-8fcf-4e3a-84e6-ef317404cb1a', '0593e0d6-7641-40be-b842-e9f3edaaf953', 'c5519843-ff38-454a-888f-212215ed7b46'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:19:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:19:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:19:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:08 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:19:08 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:09 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.273s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:19:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Deleted volume successfully. Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-38dd4469-6fe6-4062-9257-36ac18168743 tempest-ProjectReaderTests-682714229 None] Lock "cinder-2aa77b13-de0c-4b9f-9ff1-82aa2882d6bc-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Flow 'volume_create_manager' (44f4637d-ad7d-4458-9297-af062ab60255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707a1134-1bca-4756-920f-5ceea2802474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707a1134-1bca-4756-920f-5ceea2802474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-849381118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d4d9c6-7af4-447a-aca6-861bcaa33ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700398e5d7f54cd79c5095ae63a4ea61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:19:10Z,use_quota=True,user_id='633ef8f2267d4a289765da8e660322a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb9885a-cb66-44c8-9cfe-27c7a8480898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8eb9885a-cb66-44c8-9cfe-27c7a8480898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480489d0-eade-44fc-a014-463a4ab2ee62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (480489d0-eade-44fc-a014-463a4ab2ee62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d4d9c6-7af4-447a-aca6-861bcaa33ab6', 'volume_name': 'volume-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4893612f-773f-46bf-b773-84b19c360c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4893612f-773f-46bf-b773-84b19c360c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2545db-b1aa-497b-aa74-fa9eb55e54c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:09 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Volume c4d4d9c6-7af4-447a-aca6-861bcaa33ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6', 'volume_size': 1} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:19:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-849381118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4d4d9c6-7af4-447a-aca6-861bcaa33ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700398e5d7f54cd79c5095ae63a4ea61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:19:10Z,use_quota=True,user_id='633ef8f2267d4a289765da8e660322a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Creating volume c4d4d9c6-7af4-447a-aca6-861bcaa33ab6 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:19:09 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:19:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:09 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6 1073741824 Sep 04 19:19:09 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:10 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6 1073741824" returned: 0 in 0.431s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:10 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6 Sep 04 19:19:10 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:10 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6" returned: 0 in 0.266s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:19:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b2545db-b1aa-497b-aa74-fa9eb55e54c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9d48a2-c8d5-4ae6-a3f8-11764773170c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:10 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Volume volume-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6 (c4d4d9c6-7af4-447a-aca6-861bcaa33ab6): created successfully Sep 04 19:19:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e9d48a2-c8d5-4ae6-a3f8-11764773170c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Flow 'volume_create_manager' (44f4637d-ad7d-4458-9297-af062ab60255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:19:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-be9f039a-1b7f-4f95-94bd-790ac7a64c5c tempest-ProjectReaderTests-682714229 None] Created volume successfully. Sep 04 19:19:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Acquiring lock "cinder-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Lock "cinder-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Acquiring lock "cinder-quobyte-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Lock "cinder-quobyte-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[783991a1-c6b6-419e-9e6d-9843193b49c6]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:19:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:10 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6 Sep 04 19:19:10 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:11 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6" returned: 0 in 0.395s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:11 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6 Sep 04 19:19:11 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:11 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Lock "cinder-quobyte-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6" released by "delete_volume" :: held 0.733s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:11 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Created reservations ['234afe82-4d49-4bd4-9a2e-a0413eabbcb9', '562303b7-a78b-4035-8467-87abfd3f3a17', 'a6487ea3-a073-446e-9ab6-8517464252f3', 'bbbfce9f-687a-4b37-8aa7-b0cdfc5c9696'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:19:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:19:11 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:19:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:11 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:19:11 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:11 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.262s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:11 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:19:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Deleted volume successfully. Sep 04 19:19:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8e731e15-b31e-40c3-9d39-d77cb2d14594 tempest-ProjectReaderTests-682714229 None] Lock "cinder-c4d4d9c6-7af4-447a-aca6-861bcaa33ab6-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:20 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:19:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Flow 'volume_create_manager' (44bab0f3-fde5-4450-b0a5-e2aed67f47d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:19:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40235d13-34bb-48c0-86bd-e7df794f3c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40235d13-34bb-48c0-86bd-e7df794f3c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-950680977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ab3000-4635-4bf8-bb1e-2cf193a91385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbcbe372d7b4b2f8f2dabf489e53013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:19:21Z,use_quota=True,user_id='a9fa9f9d19044cf1a1c364cd0b27a64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a18cd9a-1bd8-4cd7-8569-67f5325da0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a18cd9a-1bd8-4cd7-8569-67f5325da0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aca9eb5-4c2b-41b2-9032-1b29c91468c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7aca9eb5-4c2b-41b2-9032-1b29c91468c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14ab3000-4635-4bf8-bb1e-2cf193a91385', 'volume_name': 'volume-14ab3000-4635-4bf8-bb1e-2cf193a91385', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1775b7-f2a1-4868-acd8-352725a15fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1775b7-f2a1-4868-acd8-352725a15fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55070af-28eb-466e-a57e-005af24536be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:21 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Volume 14ab3000-4635-4bf8-bb1e-2cf193a91385: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14ab3000-4635-4bf8-bb1e-2cf193a91385', 'volume_size': 1} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-950680977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ab3000-4635-4bf8-bb1e-2cf193a91385,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbcbe372d7b4b2f8f2dabf489e53013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:19:21Z,use_quota=True,user_id='a9fa9f9d19044cf1a1c364cd0b27a64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Creating volume 14ab3000-4635-4bf8-bb1e-2cf193a91385 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:19:21 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:21 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 1073741824 Sep 04 19:19:21 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:21 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 1073741824" returned: 0 in 0.740s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:21 devstack sudo[102653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 Sep 04 19:19:21 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:22 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385" returned: 0 in 0.446s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] <== create_volume: return (1275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:19:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.278s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c55070af-28eb-466e-a57e-005af24536be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14ab3000-4635-4bf8-bb1e-2cf193a91385', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dff5c79-6687-4fc4-a034-db8bbe235d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:22 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Volume volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 (14ab3000-4635-4bf8-bb1e-2cf193a91385): created successfully Sep 04 19:19:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dff5c79-6687-4fc4-a034-db8bbe235d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:22 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Flow 'volume_create_manager' (44bab0f3-fde5-4450-b0a5-e2aed67f47d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:19:22 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0759a7d3-90ab-4569-9aa2-0b6b895ce3ca tempest-TestStampPattern-777068046 None] Created volume successfully. Sep 04 19:19:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-21e9c34c-3328-4a23-ad29-596e034aeb8f tempest-TestShelveInstance-1095350994 None] Terminate volume connection completed successfully. Sep 04 19:19:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-21e9c34c-3328-4a23-ad29-596e034aeb8f tempest-TestShelveInstance-1095350994 None] Deleting attachment f55ee006-fa44-42e0-972d-fe0f0d1f1205. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:19:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Acquiring lock "cinder-d8091bf3-65cc-49be-baff-6e4c80202d4e-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Lock "cinder-d8091bf3-65cc-49be-baff-6e4c80202d4e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Acquiring lock "cinder-quobyte-d8091bf3-65cc-49be-baff-6e4c80202d4e" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Lock "cinder-quobyte-d8091bf3-65cc-49be-baff-6e4c80202d4e" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:24 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9679a6ba-c213-4ed0-8f42-7cb62387f266]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:19:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:24 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e Sep 04 19:19:24 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:25 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e" returned: 0 in 0.743s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:25 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e Sep 04 19:19:25 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:25 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8091bf3-65cc-49be-baff-6e4c80202d4e" returned: 0 in 0.382s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Lock "cinder-quobyte-d8091bf3-65cc-49be-baff-6e4c80202d4e" released by "delete_volume" :: held 1.196s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:25 devstack cinder-volume[87560]: DEBUG cinder.quota [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Created reservations ['cbec7260-3dbb-40d6-9d75-09612c3ac292', '0fcf3995-e96d-45e5-a9ae-e5238eb1a4c7', 'f9c4e198-05d7-4d67-80bc-5e99d7f9d21d', 'b4f8127c-674c-439d-bb34-613a54931411'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:19:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:19:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:19:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:26 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:19:26 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:26 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.292s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:26 devstack cinder-volume[87560]: DEBUG cinder.manager [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:19:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Deleted volume successfully. Sep 04 19:19:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [req-53e91860-aad8-4f0b-a4bc-7f9c91317d87 req-4471cbae-9e5b-4ac3-a458-f2c1e1e97f25 tempest-TestShelveInstance-1095350994 None] Lock "cinder-d8091bf3-65cc-49be-baff-6e4c80202d4e-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:36 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=19,cinder:INSERT=7,cinder:UPDATE=31,cinder:DELETE=2 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:19:36 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=20,cinder:INSERT=7,cinder:UPDATE=28,cinder:DELETE=3 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Flow 'volume_create_manager' (65e11863-e26c-45bf-a05a-1b2a82678f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e263bb1-0e79-46bd-bcca-a4c7574337bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e263bb1-0e79-46bd-bcca-a4c7574337bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-892793267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9daa08c-8f4a-415e-915e-b6c009c7d9a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe8c05d97be645eca07bd337b8a9dd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:19:41Z,use_quota=True,user_id='309f8ef991f9496b88ec8450e345e4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f84383-916a-4fcb-916f-7aea6c7cc3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9f84383-916a-4fcb-916f-7aea6c7cc3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73312dcc-2bc9-4ccd-bd83-19235b5613e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73312dcc-2bc9-4ccd-bd83-19235b5613e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9daa08c-8f4a-415e-915e-b6c009c7d9a7', 'volume_name': 'volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5834cc83-9099-4d52-8eee-ee938928395a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5834cc83-9099-4d52-8eee-ee938928395a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c3ea25-594c-4792-b1e5-67abf1206733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:41 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Volume a9daa08c-8f4a-415e-915e-b6c009c7d9a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7', 'volume_size': 1} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-892793267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9daa08c-8f4a-415e-915e-b6c009c7d9a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe8c05d97be645eca07bd337b8a9dd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:19:41Z,use_quota=True,user_id='309f8ef991f9496b88ec8450e345e4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Creating volume a9daa08c-8f4a-415e-915e-b6c009c7d9a7 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:19:41 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:19:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:41 devstack sudo[102812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 1073741824 Sep 04 19:19:41 devstack sudo[102812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:42 devstack sudo[102812]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 1073741824" returned: 0 in 0.592s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:42 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 Sep 04 19:19:42 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:42 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7" returned: 0 in 0.437s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:19:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52c3ea25-594c-4792-b1e5-67abf1206733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb4bac3-df7a-46f2-8a99-7e2607f61735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:42 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Volume volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 (a9daa08c-8f4a-415e-915e-b6c009c7d9a7): created successfully Sep 04 19:19:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cb4bac3-df7a-46f2-8a99-7e2607f61735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Flow 'volume_create_manager' (65e11863-e26c-45bf-a05a-1b2a82678f93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:19:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4e144b17-38b4-4bac-9147-3b5908f730e1 tempest-SnapshotDependencyTests-1454298282 None] Created volume successfully. Sep 04 19:19:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] Creating offline snapshot dc772df7-5b5b-4c50-9c89-2273ba91160a of volume a9daa08c-8f4a-415e-915e-b6c009c7d9a7 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:19:43 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0a4ef6-251e-4f70-b540-bb4f59f1981e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:19:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:44 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 Sep 04 19:19:44 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:44 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7" returned: 0 in 0.486s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:44 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a 1G Sep 04 19:19:44 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:44 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a 1G" returned: 0 in 0.614s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:45 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a Sep 04 19:19:45 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:19:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:19:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:19:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:45 devstack sudo[102838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:19:45 devstack sudo[102838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:45 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a" returned: 0 in 0.397s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:45 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a is being set with open permissions: ugo+rw Sep 04 19:19:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:45 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a Sep 04 19:19:45 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:45 devstack sudo[102838]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.421s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:19:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:19:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:19:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:19:45 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a" returned: 0 in 0.405s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:45 devstack sudo[102849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.info Sep 04 19:19:45 devstack sudo[102849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:46 devstack sudo[102849]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.info" returned: 0 in 0.358s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:46 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.info is being set with open permissions: ugo+rw Sep 04 19:19:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:46 devstack sudo[102852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.info Sep 04 19:19:46 devstack sudo[102852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:46 devstack sudo[102852]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.info" returned: 0 in 0.300s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7d610e19-1809-466d-a813-7d06696d7dff tempest-SnapshotDependencyTests-1454298282 None] Create snapshot completed successfully Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Flow 'volume_create_manager' (dc37de05-a2a5-4984-bf7d-e600d32665f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (839deaab-d4c3-4561-a085-fc3c824d4992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (839deaab-d4c3-4561-a085-fc3c824d4992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:19:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53ca7c02-2954-447e-a457-c3845729f59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe8c05d97be645eca07bd337b8a9dd89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=dc772df7-5b5b-4c50-9c89-2273ba91160a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:19:48Z,use_quota=True,user_id='309f8ef991f9496b88ec8450e345e4c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5fe10d-c2be-41f0-be56-354ffcc1da18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e5fe10d-c2be-41f0-be56-354ffcc1da18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a82c029-2a47-4f2e-b98b-00354c1e7520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a82c029-2a47-4f2e-b98b-00354c1e7520) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '53ca7c02-2954-447e-a457-c3845729f59d', 'volume_name': 'volume-53ca7c02-2954-447e-a457-c3845729f59d', 'volume_size': 1, 'snapshot_id': 'dc772df7-5b5b-4c50-9c89-2273ba91160a'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873e6120-a4d7-4245-a656-e08be81b5bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (873e6120-a4d7-4245-a656-e08be81b5bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d9530e-596a-4301-b388-4f7ded4453e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:47 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Volume 53ca7c02-2954-447e-a457-c3845729f59d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-53ca7c02-2954-447e-a457-c3845729f59d', 'volume_size': 1, 'snapshot_id': 'dc772df7-5b5b-4c50-9c89-2273ba91160a'} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "cinder-quobyte-dc772df7-5b5b-4c50-9c89-2273ba91160a-53ca7c02-2954-447e-a457-c3845729f59d" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-quobyte-dc772df7-5b5b-4c50-9c89-2273ba91160a-53ca7c02-2954-447e-a457-c3845729f59d" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Creating volume 53ca7c02-2954-447e-a457-c3845729f59d from snapshot dc772df7-5b5b-4c50-9c89-2273ba91160a {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "cinder-quobyte-53ca7c02-2954-447e-a457-c3845729f59d" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-quobyte-53ca7c02-2954-447e-a457-c3845729f59d" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] snapshot: dc772df7-5b5b-4c50-9c89-2273ba91160a, volume: 53ca7c02-2954-447e-a457-c3845729f59d, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:19:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:19:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd24d049-b773-4a45-b634-c6bb975e92c8]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:19:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:48 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a Sep 04 19:19:48 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:48 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a" returned: 0 in 0.415s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:19:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3936b9-a045-4efe-8872-7b527b8ddf5e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:19:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:48 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 Sep 04 19:19:48 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:48 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7" returned: 0 in 0.426s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 19:19:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 19:19:48 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Path /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-53ca7c02-2954-447e-a457-c3845729f59d not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 19:19:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-53ca7c02-2954-447e-a457-c3845729f59d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:48 devstack sudo[102866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-53ca7c02-2954-447e-a457-c3845729f59d Sep 04 19:19:48 devstack sudo[102866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:53 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:19:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Flow 'volume_create_manager' (7165a9a7-8535-496b-8655-25466aa3204e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:19:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c56e9979-f0b6-4298-8448-f36ef0a12dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c56e9979-f0b6-4298-8448-f36ef0a12dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2501556b-0fff-402b-bbd7-7533aefbee2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37175777b19a4e90bf72f08c7f930b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:19:54Z,use_quota=True,user_id='96cfc591e5c74b33bb2363aee1ae6807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50cc2918-9679-43c2-b23f-74fe76121d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50cc2918-9679-43c2-b23f-74fe76121d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea12bbb4-21b5-40e8-96c3-0da849518c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea12bbb4-21b5-40e8-96c3-0da849518c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2501556b-0fff-402b-bbd7-7533aefbee2f', 'volume_name': 'volume-2501556b-0fff-402b-bbd7-7533aefbee2f', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cbc4144-1577-45a3-97d9-3239edb65afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cbc4144-1577-45a3-97d9-3239edb65afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61930b24-89fd-4f21-afe0-9222c0215465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:54 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Volume 2501556b-0fff-402b-bbd7-7533aefbee2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2501556b-0fff-402b-bbd7-7533aefbee2f', 'volume_size': 1} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:54 devstack sudo[102866]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-53ca7c02-2954-447e-a457-c3845729f59d" returned: 0 in 5.333s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7, size 1024.00 MB, duration 5.33 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-53ca7c02-2954-447e-a457-c3845729f59d {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:19:54 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Converted 1024.00 MB image at 191.99 MB/s Sep 04 19:19:54 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-53ca7c02-2954-447e-a457-c3845729f59d is being set with open permissions: ugo+rw Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-53ca7c02-2954-447e-a457-c3845729f59d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:54 devstack sudo[102924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-53ca7c02-2954-447e-a457-c3845729f59d Sep 04 19:19:54 devstack sudo[102924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:54 devstack sudo[102924]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-53ca7c02-2954-447e-a457-c3845729f59d" returned: 0 in 0.244s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-quobyte-53ca7c02-2954-447e-a457-c3845729f59d" released by "_copy_volume_from_snapshot" :: held 6.495s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-quobyte-dc772df7-5b5b-4c50-9c89-2273ba91160a-53ca7c02-2954-447e-a457-c3845729f59d" released by "_create_volume_from_snapshot" :: held 6.558s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.576s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.470s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2501556b-0fff-402b-bbd7-7533aefbee2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37175777b19a4e90bf72f08c7f930b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:19:54Z,use_quota=True,user_id='96cfc591e5c74b33bb2363aee1ae6807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Creating volume 2501556b-0fff-402b-bbd7-7533aefbee2f {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:19:54 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2501556b-0fff-402b-bbd7-7533aefbee2f 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:54 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2501556b-0fff-402b-bbd7-7533aefbee2f 1073741824 Sep 04 19:19:54 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5d9530e-596a-4301-b388-4f7ded4453e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53ca7c02-2954-447e-a457-c3845729f59d', 'volume_size': 1, 'snapshot_id': 'dc772df7-5b5b-4c50-9c89-2273ba91160a'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f264847-2ffc-40a9-8d9a-fe2613a1f774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:54 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Volume volume-53ca7c02-2954-447e-a457-c3845729f59d (53ca7c02-2954-447e-a457-c3845729f59d): created successfully Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f264847-2ffc-40a9-8d9a-fe2613a1f774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Flow 'volume_create_manager' (dc37de05-a2a5-4984-bf7d-e600d32665f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:19:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-49b9825e-67e3-4fdc-a133-12a10be7dfb0 tempest-SnapshotDependencyTests-1454298282 None] Created volume successfully. Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "cinder-dc772df7-5b5b-4c50-9c89-2273ba91160a-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-dc772df7-5b5b-4c50-9c89-2273ba91160a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "cinder-quobyte-a9daa08c-8f4a-415e-915e-b6c009c7d9a7" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-quobyte-a9daa08c-8f4a-415e-915e-b6c009c7d9a7" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "cinder-quobyte-dc772df7-5b5b-4c50-9c89-2273ba91160a" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-quobyte-dc772df7-5b5b-4c50-9c89-2273ba91160a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Deleting offline snapshot dc772df7-5b5b-4c50-9c89-2273ba91160a of volume a9daa08c-8f4a-415e-915e-b6c009c7d9a7 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] snapshot_file for this snap is: volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbfd1b44-df8a-4402-aca6-410336233ff2]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:54 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2501556b-0fff-402b-bbd7-7533aefbee2f 1073741824" returned: 0 in 0.455s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:54 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a Sep 04 19:19:54 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2501556b-0fff-402b-bbd7-7533aefbee2f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:55 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2501556b-0fff-402b-bbd7-7533aefbee2f Sep 04 19:19:55 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:55 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2501556b-0fff-402b-bbd7-7533aefbee2f" returned: 0 in 0.242s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:19:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:55 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a" returned: 0 in 0.373s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:19:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61930b24-89fd-4f21-afe0-9222c0215465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2501556b-0fff-402b-bbd7-7533aefbee2f', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100fcec0-8337-4db8-9fca-364788fcfdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0154d4cf-7c38-46ae-8771-ff313894c099]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:19:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:55 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Volume volume-2501556b-0fff-402b-bbd7-7533aefbee2f (2501556b-0fff-402b-bbd7-7533aefbee2f): created successfully Sep 04 19:19:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (100fcec0-8337-4db8-9fca-364788fcfdea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Flow 'volume_create_manager' (7165a9a7-8535-496b-8655-25466aa3204e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:19:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0b156d4f-bd02-4590-be41-be4c2567cf5a tempest-CinderUnicodeTest-185450811 None] Created volume successfully. Sep 04 19:19:55 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 Sep 04 19:19:55 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:55 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7" returned: 0 in 0.524s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:55 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a Sep 04 19:19:55 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:56 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a" returned: 0 in 0.407s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:56 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a Sep 04 19:19:56 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Flow 'volume_create_manager' (4ed8cddb-2aaf-47f5-ad43-029b1e2c6c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b65da29-b81d-4bf7-a645-ee5241c8d15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b65da29-b81d-4bf7-a645-ee5241c8d15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:19:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-409957269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c205bae3-f436-4585-9f8e-b2b2f9052c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37175777b19a4e90bf72f08c7f930b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:19:56Z,use_quota=True,user_id='96cfc591e5c74b33bb2363aee1ae6807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1c7d34-da99-4dbc-a9f6-77429c292025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e1c7d34-da99-4dbc-a9f6-77429c292025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ecaf86-2816-466e-891e-694e2d5e9b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02ecaf86-2816-466e-891e-694e2d5e9b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c205bae3-f436-4585-9f8e-b2b2f9052c99', 'volume_name': 'volume-c205bae3-f436-4585-9f8e-b2b2f9052c99', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d998266-e76e-4279-a01b-bb9cf7ad8263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d998266-e76e-4279-a01b-bb9cf7ad8263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa0163cf-9191-4ac8-b8c3-f97a7b753beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:56 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Volume c205bae3-f436-4585-9f8e-b2b2f9052c99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c205bae3-f436-4585-9f8e-b2b2f9052c99', 'volume_size': 1} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:19:56Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-409957269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c205bae3-f436-4585-9f8e-b2b2f9052c99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37175777b19a4e90bf72f08c7f930b41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:19:56Z,use_quota=True,user_id='96cfc591e5c74b33bb2363aee1ae6807',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Creating volume c205bae3-f436-4585-9f8e-b2b2f9052c99 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:19:56 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:56 devstack sudo[102953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 1073741824 Sep 04 19:19:56 devstack sudo[102953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:56 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7.dc772df7-5b5b-4c50-9c89-2273ba91160a" returned: 0 in 0.278s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-quobyte-dc772df7-5b5b-4c50-9c89-2273ba91160a" released by "_delete_snapshot" :: held 1.713s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-quobyte-a9daa08c-8f4a-415e-915e-b6c009c7d9a7" released by "delete_snapshot" :: held 1.739s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Created reservations ['af54f709-6c49-4f52-a9d0-41fe0fbac47a', '773821c0-74d4-4e0b-b454-17900e526003', '76b9228c-07e6-421c-9a4f-326f88da1ea9', '5ccb44dd-e063-4f0e-9865-9eeec9a69a1b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:19:56 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Delete snapshot completed successfully. Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-efe6cf27-49ec-47d4-b8fe-7ad9da4da99b tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-dc772df7-5b5b-4c50-9c89-2273ba91160a-delete_snapshot" released by "delete_snapshot" :: held 1.885s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:56 devstack sudo[102953]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 1073741824" returned: 0 in 0.453s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:56 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 Sep 04 19:19:56 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "cinder-a9daa08c-8f4a-415e-915e-b6c009c7d9a7-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-a9daa08c-8f4a-415e-915e-b6c009c7d9a7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "cinder-quobyte-a9daa08c-8f4a-415e-915e-b6c009c7d9a7" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-quobyte-a9daa08c-8f4a-415e-915e-b6c009c7d9a7" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecfdbbf-951b-4117-b0f5-ba4192bb6f9e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:57 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 Sep 04 19:19:57 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:57 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99" returned: 0 in 0.315s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa0163cf-9191-4ac8-b8c3-f97a7b753beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c205bae3-f436-4585-9f8e-b2b2f9052c99', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4271ed-f24a-4eb0-968f-c65325b02934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:19:57 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Volume volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 (c205bae3-f436-4585-9f8e-b2b2f9052c99): created successfully Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f4271ed-f24a-4eb0-968f-c65325b02934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Flow 'volume_create_manager' (4ed8cddb-2aaf-47f5-ad43-029b1e2c6c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:19:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8ea2088e-c931-4683-a98b-77e8444279ed tempest-CinderUnicodeTest-185450811 None] Created volume successfully. Sep 04 19:19:57 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7" returned: 0 in 0.393s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:57 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7 Sep 04 19:19:57 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:57 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a9daa08c-8f4a-415e-915e-b6c009c7d9a7" returned: 0 in 0.266s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-quobyte-a9daa08c-8f4a-415e-915e-b6c009c7d9a7" released by "delete_volume" :: held 0.721s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Created reservations ['e2fe421a-81d4-4e17-b3cb-918c4c3bae9b', '7de286b0-b93b-4219-b816-f0f32a6d378e', 'd06f11d9-ad5c-459b-ba35-419ce02f6442', 'd94b6f04-5de1-4ba6-98c5-8b069d325ea2'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:57 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:19:57 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:58 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.264s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "cinder-53ca7c02-2954-447e-a457-c3845729f59d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Deleted volume successfully. Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-53ca7c02-2954-447e-a457-c3845729f59d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-15e134b6-da0b-4f2c-8886-bfe3a40b72de tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-a9daa08c-8f4a-415e-915e-b6c009c7d9a7-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "cinder-quobyte-53ca7c02-2954-447e-a457-c3845729f59d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-quobyte-53ca7c02-2954-447e-a457-c3845729f59d" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a3bdc7-1f9c-44f6-80af-e57db07005f9]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-53ca7c02-2954-447e-a457-c3845729f59d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:58 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-53ca7c02-2954-447e-a457-c3845729f59d Sep 04 19:19:58 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] Creating offline snapshot 1b5a3f96-fa62-4997-8c72-f8a41cd51685 of volume c205bae3-f436-4585-9f8e-b2b2f9052c99 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23c2618-fc44-4601-a935-fe3d5b46911f]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:58 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-53ca7c02-2954-447e-a457-c3845729f59d" returned: 0 in 0.432s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-53ca7c02-2954-447e-a457-c3845729f59d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:58 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-53ca7c02-2954-447e-a457-c3845729f59d Sep 04 19:19:58 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:58 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 Sep 04 19:19:58 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:58 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-53ca7c02-2954-447e-a457-c3845729f59d" returned: 0 in 0.237s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-quobyte-53ca7c02-2954-447e-a457-c3845729f59d" released by "delete_volume" :: held 0.725s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:59 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Created reservations ['bdfa3dae-a016-42f5-9e17-b2b3743dba73', '27f2b906-2ae7-4b89-9f13-da72748ba846', 'd08ef534-31ad-42da-82c9-bcfa7457e72d', 'ccfc6113-b1f8-411b-a510-23b3f5a118b6'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:19:59 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99" returned: 0 in 0.362s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:59 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685 1G Sep 04 19:19:59 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:19:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:19:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:19:59 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:19:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:19:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:59 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:19:59 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:59 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:59 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:19:59 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Deleted volume successfully. Sep 04 19:19:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2263b1fe-474b-4c9b-ad19-56291a891671 tempest-SnapshotDependencyTests-1454298282 None] Lock "cinder-53ca7c02-2954-447e-a457-c3845729f59d-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:19:59 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685 1G" returned: 0 in 0.546s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:59 devstack sudo[102998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685 Sep 04 19:19:59 devstack sudo[102998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:19:59 devstack sudo[102998]: pam_unix(sudo:session): session closed for user root Sep 04 19:19:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685" returned: 0 in 0.311s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:19:59 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685 is being set with open permissions: ugo+rw Sep 04 19:19:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:19:59 devstack sudo[103007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685 Sep 04 19:19:59 devstack sudo[103007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:00 devstack sudo[103007]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685" returned: 0 in 0.273s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:00 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.info Sep 04 19:20:00 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bd0792de-6043-4758-a8f0-74d889278f95 req-9af67e5f-debc-41d2-b015-b223e086e2e6 tempest-TestStampPattern-777068046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:20:00 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.info" returned: 0 in 0.294s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:00 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.info is being set with open permissions: ugo+rw Sep 04 19:20:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:00 devstack sudo[103021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.info Sep 04 19:20:00 devstack sudo[103021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:00 devstack sudo[103021]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.info" returned: 0 in 0.251s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.136s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:20:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bd0792de-6043-4758-a8f0-74d889278f95 req-9af67e5f-debc-41d2-b015-b223e086e2e6 tempest-TestStampPattern-777068046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.442s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:20:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-bd0792de-6043-4758-a8f0-74d889278f95 req-9af67e5f-debc-41d2-b015-b223e086e2e6 tempest-TestStampPattern-777068046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:20:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9550ff67-b6b7-449d-b46c-37beb68c724c tempest-CinderUnicodeTest-185450811 None] Create snapshot completed successfully Sep 04 19:20:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-bd0792de-6043-4758-a8f0-74d889278f95 req-9af67e5f-debc-41d2-b015-b223e086e2e6 tempest-TestStampPattern-777068046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-14ab3000-4635-4bf8-bb1e-2cf193a91385', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee0d86ae-bccc-446b-adfc-28ba07a3039f', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:20:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-bd0792de-6043-4758-a8f0-74d889278f95 req-9af67e5f-debc-41d2-b015-b223e086e2e6 tempest-TestStampPattern-777068046 None] attachment_update completed successfully. Sep 04 19:20:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Acquiring lock "cinder-1b5a3f96-fa62-4997-8c72-f8a41cd51685-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:20:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Lock "cinder-1b5a3f96-fa62-4997-8c72-f8a41cd51685-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:20:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Acquiring lock "cinder-quobyte-c205bae3-f436-4585-9f8e-b2b2f9052c99" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:20:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Lock "cinder-quobyte-c205bae3-f436-4585-9f8e-b2b2f9052c99" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:20:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Acquiring lock "cinder-quobyte-1b5a3f96-fa62-4997-8c72-f8a41cd51685" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:20:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Lock "cinder-quobyte-1b5a3f96-fa62-4997-8c72-f8a41cd51685" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:20:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Deleting offline snapshot 1b5a3f96-fa62-4997-8c72-f8a41cd51685 of volume c205bae3-f436-4585-9f8e-b2b2f9052c99 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:20:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] snapshot_file for this snap is: volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:20:01 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded5357d-4768-4190-b4bd-1aece8ac04a4]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:20:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:02 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685 Sep 04 19:20:02 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:02 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685" returned: 0 in 0.407s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c205bae3-f436-4585-9f8e-b2b2f9052c99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:20:02 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7f4a07-4fdb-4230-a806-26e3155f10af]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:20:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:02 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 Sep 04 19:20:02 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:02 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99" returned: 0 in 0.358s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:02 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685 Sep 04 19:20:02 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:03 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685" returned: 0 in 0.508s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:03 devstack sudo[103435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685 Sep 04 19:20:03 devstack sudo[103435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:03 devstack sudo[103435]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99.1b5a3f96-fa62-4997-8c72-f8a41cd51685" returned: 0 in 0.281s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Lock "cinder-quobyte-1b5a3f96-fa62-4997-8c72-f8a41cd51685" released by "_delete_snapshot" :: held 1.672s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:20:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Lock "cinder-quobyte-c205bae3-f436-4585-9f8e-b2b2f9052c99" released by "delete_snapshot" :: held 1.702s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:20:03 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Created reservations ['908a8bce-815d-4e00-a17a-a1602d884721', '331cbdcd-51d0-4d3e-8190-1299a2cf56a2', 'ba18dbe1-a024-4b7b-b125-e45865595a0e', 'c5b8b692-9384-4668-9181-69f490349699'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:20:03 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Delete snapshot completed successfully. Sep 04 19:20:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f7c777d4-bba8-4793-9239-dc7bf8c3e477 tempest-CinderUnicodeTest-185450811 None] Lock "cinder-1b5a3f96-fa62-4997-8c72-f8a41cd51685-delete_snapshot" released by "delete_snapshot" :: held 1.872s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:20:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Acquiring lock "cinder-c205bae3-f436-4585-9f8e-b2b2f9052c99-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:20:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Lock "cinder-c205bae3-f436-4585-9f8e-b2b2f9052c99-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:20:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Acquiring lock "cinder-quobyte-c205bae3-f436-4585-9f8e-b2b2f9052c99" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:20:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Lock "cinder-quobyte-c205bae3-f436-4585-9f8e-b2b2f9052c99" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:20:04 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[395e1859-9d9a-41fe-957e-fd378790355b]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:20:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:04 devstack sudo[103439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 Sep 04 19:20:04 devstack sudo[103439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:04 devstack sudo[103439]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99" returned: 0 in 0.390s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:04 devstack sudo[103449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99 Sep 04 19:20:04 devstack sudo[103449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:04 devstack sudo[103449]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c205bae3-f436-4585-9f8e-b2b2f9052c99" returned: 0 in 0.273s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Lock "cinder-quobyte-c205bae3-f436-4585-9f8e-b2b2f9052c99" released by "delete_volume" :: held 0.735s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:20:04 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Created reservations ['6bc62b23-b19c-4590-8015-7dbdde8e6da6', '325d0b79-234e-4441-a24c-2d9382f062ac', '3264012e-acb8-4f1e-8c1f-3f4ca66d3921', 'e4dcd685-27fc-4a42-8641-3783e9827f8e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:05 devstack sudo[103460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:20:05 devstack sudo[103460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Acquiring lock "cinder-2501556b-0fff-402b-bbd7-7533aefbee2f-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Lock "cinder-2501556b-0fff-402b-bbd7-7533aefbee2f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Acquiring lock "cinder-quobyte-2501556b-0fff-402b-bbd7-7533aefbee2f" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:20:05 devstack sudo[103460]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.369s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Lock "cinder-quobyte-2501556b-0fff-402b-bbd7-7533aefbee2f" acquired by "delete_volume" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:20:05 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Deleted volume successfully. Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[db089133-230f-497f-97cf-2fdbe85deb0f]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2501556b-0fff-402b-bbd7-7533aefbee2f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a13e8080-c8c4-43ce-ae78-99053a80456d tempest-CinderUnicodeTest-185450811 None] Lock "cinder-c205bae3-f436-4585-9f8e-b2b2f9052c99-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:20:05 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2501556b-0fff-402b-bbd7-7533aefbee2f Sep 04 19:20:05 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:05 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2501556b-0fff-402b-bbd7-7533aefbee2f" returned: 0 in 0.408s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2501556b-0fff-402b-bbd7-7533aefbee2f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:05 devstack sudo[103495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2501556b-0fff-402b-bbd7-7533aefbee2f Sep 04 19:20:05 devstack sudo[103495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:05 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-ace0bebd-6e33-4b01-a507-0d1f0894b8a4 req-93e33b07-f46e-4d3c-9780-0a1aef33b78f tempest-TestStampPattern-777068046 None] Terminate volume connection completed successfully. Sep 04 19:20:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-ace0bebd-6e33-4b01-a507-0d1f0894b8a4 req-93e33b07-f46e-4d3c-9780-0a1aef33b78f tempest-TestStampPattern-777068046 None] Deleting attachment ee0d86ae-bccc-446b-adfc-28ba07a3039f. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:20:06 devstack sudo[103495]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2501556b-0fff-402b-bbd7-7533aefbee2f" returned: 0 in 0.336s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Lock "cinder-quobyte-2501556b-0fff-402b-bbd7-7533aefbee2f" released by "delete_volume" :: held 0.796s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:20:06 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Created reservations ['84a57396-66c9-4443-b144-e19636b7510a', '9340dcd2-b883-4359-932e-e98e1d52b6dd', '952b208d-b390-4db0-b20c-f1c55e31ca04', 'e737f458-e058-4305-89e6-fe1cc22a5180'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:20:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:20:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:20:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:20:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:20:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:20:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:06 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:20:06 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:06 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.273s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:06 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:20:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Deleted volume successfully. Sep 04 19:20:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f9617c66-72aa-4af9-bbf1-2ffad177d0a7 tempest-CinderUnicodeTest-185450811 None] Lock "cinder-2501556b-0fff-402b-bbd7-7533aefbee2f-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:20:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:20:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:20:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] Creating offline snapshot 69c256a5-d71a-4f30-8a9a-498cf28a1d24 of volume 14ab3000-4635-4bf8-bb1e-2cf193a91385 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:20:07 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7aacb0d-4045-4c29-9aa7-b96b4e23ec3a]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:20:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:07 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 Sep 04 19:20:07 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:07 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385" returned: 0 in 0.468s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:07 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 1G Sep 04 19:20:07 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:07 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 1G" returned: 0 in 0.409s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:07 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 Sep 04 19:20:07 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:08 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24" returned: 0 in 0.346s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:08 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 is being set with open permissions: ugo+rw Sep 04 19:20:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:08 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 Sep 04 19:20:08 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:08 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24" returned: 0 in 0.332s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:08 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.info Sep 04 19:20:08 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:08 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.info" returned: 0 in 0.285s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:08 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.info is being set with open permissions: ugo+rw Sep 04 19:20:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:08 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.info Sep 04 19:20:08 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:09 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.info" returned: 0 in 0.255s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.195s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:20:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f8d8fb6e-c4eb-4edb-8985-8f948e7f052e tempest-TestStampPattern-777068046 None] Create snapshot completed successfully Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Flow 'volume_create_manager' (eb38e9fa-38dd-4004-9f3a-db033c717de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcdb819-26a0-4aee-812d-452698a9b34d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdcdb819-26a0-4aee-812d-452698a9b34d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1852198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2f91285-d7c8-4449-a82d-9cef78fb649d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fbcbe372d7b4b2f8f2dabf489e53013',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=69c256a5-d71a-4f30-8a9a-498cf28a1d24,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:20:17Z,use_quota=True,user_id='a9fa9f9d19044cf1a1c364cd0b27a64e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd4d307-376f-4ddd-87ff-16e6e4fb71e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bd4d307-376f-4ddd-87ff-16e6e4fb71e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48298fd0-7aa8-4a6e-a67b-9ed4d8b474a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48298fd0-7aa8-4a6e-a67b-9ed4d8b474a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c2f91285-d7c8-4449-a82d-9cef78fb649d', 'volume_name': 'volume-c2f91285-d7c8-4449-a82d-9cef78fb649d', 'volume_size': 1, 'snapshot_id': '69c256a5-d71a-4f30-8a9a-498cf28a1d24'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9f5cea-6edc-4c49-95eb-bcc8b05456f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e9f5cea-6edc-4c49-95eb-bcc8b05456f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8541611f-af91-41e8-85b0-579e4404e1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:20:17 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Volume c2f91285-d7c8-4449-a82d-9cef78fb649d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c2f91285-d7c8-4449-a82d-9cef78fb649d', 'volume_size': 1, 'snapshot_id': '69c256a5-d71a-4f30-8a9a-498cf28a1d24'} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Acquiring lock "cinder-quobyte-69c256a5-d71a-4f30-8a9a-498cf28a1d24-c2f91285-d7c8-4449-a82d-9cef78fb649d" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Lock "cinder-quobyte-69c256a5-d71a-4f30-8a9a-498cf28a1d24-c2f91285-d7c8-4449-a82d-9cef78fb649d" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Creating volume c2f91285-d7c8-4449-a82d-9cef78fb649d from snapshot 69c256a5-d71a-4f30-8a9a-498cf28a1d24 {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Acquiring lock "cinder-quobyte-c2f91285-d7c8-4449-a82d-9cef78fb649d" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Lock "cinder-quobyte-c2f91285-d7c8-4449-a82d-9cef78fb649d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] snapshot: 69c256a5-d71a-4f30-8a9a-498cf28a1d24, volume: c2f91285-d7c8-4449-a82d-9cef78fb649d, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[85623df2-d3c1-4d32-a564-46275d97ce0b]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:17 devstack sudo[103557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 Sep 04 19:20:17 devstack sudo[103557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:17 devstack sudo[103557]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24" returned: 0 in 0.363s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14ab3000-4635-4bf8-bb1e-2cf193a91385(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb8c61b-97d7-4bfd-9e13-d548371964bf]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:20:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:17 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 Sep 04 19:20:17 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:18 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385" returned: 0 in 0.406s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 19:20:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 19:20:18 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Path /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c2f91285-d7c8-4449-a82d-9cef78fb649d not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 19:20:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c2f91285-d7c8-4449-a82d-9cef78fb649d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:18 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c2f91285-d7c8-4449-a82d-9cef78fb649d Sep 04 19:20:18 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:23 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c2f91285-d7c8-4449-a82d-9cef78fb649d" returned: 0 in 5.632s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:23 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385, size 1024.00 MB, duration 5.63 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c2f91285-d7c8-4449-a82d-9cef78fb649d {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:20:23 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Converted 1024.00 MB image at 181.77 MB/s Sep 04 19:20:23 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c2f91285-d7c8-4449-a82d-9cef78fb649d is being set with open permissions: ugo+rw Sep 04 19:20:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c2f91285-d7c8-4449-a82d-9cef78fb649d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:23 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c2f91285-d7c8-4449-a82d-9cef78fb649d Sep 04 19:20:23 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:24 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c2f91285-d7c8-4449-a82d-9cef78fb649d" returned: 0 in 0.303s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Lock "cinder-quobyte-c2f91285-d7c8-4449-a82d-9cef78fb649d" released by "_copy_volume_from_snapshot" :: held 6.809s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:20:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Lock "cinder-quobyte-69c256a5-d71a-4f30-8a9a-498cf28a1d24-c2f91285-d7c8-4449-a82d-9cef78fb649d" released by "_create_volume_from_snapshot" :: held 6.880s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:20:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.895s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:20:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8541611f-af91-41e8-85b0-579e4404e1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2f91285-d7c8-4449-a82d-9cef78fb649d', 'volume_size': 1, 'snapshot_id': '69c256a5-d71a-4f30-8a9a-498cf28a1d24'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:20:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ce42d8-8b27-4ed9-b30c-c66eadf913c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:20:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Volume volume-c2f91285-d7c8-4449-a82d-9cef78fb649d (c2f91285-d7c8-4449-a82d-9cef78fb649d): created successfully Sep 04 19:20:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ce42d8-8b27-4ed9-b30c-c66eadf913c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:20:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Flow 'volume_create_manager' (eb38e9fa-38dd-4004-9f3a-db033c717de6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:20:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-96b2b033-01c1-4ec9-9655-51c1379da6e2 tempest-TestStampPattern-777068046 None] Created volume successfully. Sep 04 19:20:34 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=58,cinder:UPDATE=69,cinder:INSERT=16,cinder:DELETE=4 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:20:34 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=59,cinder:SELECT=66,cinder:INSERT=16,cinder:DELETE=8 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:20:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:20:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:20:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:20:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:20:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:20:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:20:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:20:45 devstack sudo[103708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:20:45 devstack sudo[103708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:20:45 devstack sudo[103708]: pam_unix(sudo:session): session closed for user root Sep 04 19:20:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.234s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:20:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:20:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:20:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:20:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:20:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-afaeebc8-8c37-4602-ba33-3c0f127e64c5 req-f4d938ca-3c08-400e-be9b-12063f1ac1f8 tempest-TestStampPattern-777068046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:20:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-afaeebc8-8c37-4602-ba33-3c0f127e64c5 req-f4d938ca-3c08-400e-be9b-12063f1ac1f8 tempest-TestStampPattern-777068046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:20:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [req-afaeebc8-8c37-4602-ba33-3c0f127e64c5 req-f4d938ca-3c08-400e-be9b-12063f1ac1f8 tempest-TestStampPattern-777068046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:20:52 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-afaeebc8-8c37-4602-ba33-3c0f127e64c5 req-f4d938ca-3c08-400e-be9b-12063f1ac1f8 tempest-TestStampPattern-777068046 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860', 'name': 'volume-c2f91285-d7c8-4449-a82d-9cef78fb649d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7cb37484-c3ee-4ed4-b86f-c7062bb075c4', 'enforce_multipath': True} {{(pid=87560) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 04 19:20:52 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-afaeebc8-8c37-4602-ba33-3c0f127e64c5 req-f4d938ca-3c08-400e-be9b-12063f1ac1f8 tempest-TestStampPattern-777068046 None] attachment_update completed successfully. Sep 04 19:20:56 devstack cinder-volume[87560]: INFO cinder.volume.manager [req-2de3b4f2-d08b-460c-b0fb-90c497f62926 req-95a03dd8-8060-448d-952b-14c20a2de77c tempest-TestStampPattern-777068046 None] Terminate volume connection completed successfully. Sep 04 19:20:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [req-2de3b4f2-d08b-460c-b0fb-90c497f62926 req-95a03dd8-8060-448d-952b-14c20a2de77c tempest-TestStampPattern-777068046 None] Deleting attachment 7cb37484-c3ee-4ed4-b86f-c7062bb075c4. {{(pid=87560) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 04 19:21:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Acquiring lock "cinder-c2f91285-d7c8-4449-a82d-9cef78fb649d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Lock "cinder-c2f91285-d7c8-4449-a82d-9cef78fb649d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Acquiring lock "cinder-quobyte-c2f91285-d7c8-4449-a82d-9cef78fb649d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Lock "cinder-quobyte-c2f91285-d7c8-4449-a82d-9cef78fb649d" acquired by "delete_volume" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:00 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[580c35cb-0320-46bc-92b9-a35303236727]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c2f91285-d7c8-4449-a82d-9cef78fb649d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:00 devstack sudo[104200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c2f91285-d7c8-4449-a82d-9cef78fb649d Sep 04 19:21:00 devstack sudo[104200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:00 devstack sudo[104200]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c2f91285-d7c8-4449-a82d-9cef78fb649d" returned: 0 in 0.339s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c2f91285-d7c8-4449-a82d-9cef78fb649d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:00 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c2f91285-d7c8-4449-a82d-9cef78fb649d Sep 04 19:21:00 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:00 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c2f91285-d7c8-4449-a82d-9cef78fb649d" returned: 0 in 0.230s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Lock "cinder-quobyte-c2f91285-d7c8-4449-a82d-9cef78fb649d" released by "delete_volume" :: held 0.604s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Created reservations ['48937dca-bc2f-481e-86c3-e40dbf2cdfe1', '4df17f12-44a9-48b2-aacc-8f481ea7a231', '025f1978-152b-4d55-9c82-49d6a52c50ea', '06c0dc65-b002-4b6a-b11f-e0c85f5ce4b0'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:01 devstack sudo[104208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:21:01 devstack sudo[104208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:01 devstack sudo[104208]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.232s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:21:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Deleted volume successfully. Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-bc3e1820-e6c9-4a38-8fda-1ccd636730b6 tempest-TestStampPattern-777068046 None] Lock "cinder-c2f91285-d7c8-4449-a82d-9cef78fb649d-delete_volume" released by "delete_volume" :: held 1.011s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Acquiring lock "cinder-69c256a5-d71a-4f30-8a9a-498cf28a1d24-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Lock "cinder-69c256a5-d71a-4f30-8a9a-498cf28a1d24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Acquiring lock "cinder-quobyte-14ab3000-4635-4bf8-bb1e-2cf193a91385" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Lock "cinder-quobyte-14ab3000-4635-4bf8-bb1e-2cf193a91385" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Acquiring lock "cinder-quobyte-69c256a5-d71a-4f30-8a9a-498cf28a1d24" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Lock "cinder-quobyte-69c256a5-d71a-4f30-8a9a-498cf28a1d24" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Deleting offline snapshot 69c256a5-d71a-4f30-8a9a-498cf28a1d24 of volume 14ab3000-4635-4bf8-bb1e-2cf193a91385 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] snapshot_file for this snap is: volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99066be-11b7-4bcd-b630-d700d66e9434]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:01 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 Sep 04 19:21:01 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:02 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24" returned: 0 in 0.346s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-14ab3000-4635-4bf8-bb1e-2cf193a91385(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:21:02 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f503d0-8431-447b-83b0-5d04060b2b53]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:02 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 Sep 04 19:21:02 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:02 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385" returned: 0 in 0.484s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:02 devstack sudo[104222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 Sep 04 19:21:02 devstack sudo[104222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:02 devstack sudo[104222]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24" returned: 0 in 0.311s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:02 devstack sudo[104227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24 Sep 04 19:21:02 devstack sudo[104227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:03 devstack sudo[104227]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385.69c256a5-d71a-4f30-8a9a-498cf28a1d24" returned: 0 in 0.230s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Lock "cinder-quobyte-69c256a5-d71a-4f30-8a9a-498cf28a1d24" released by "_delete_snapshot" :: held 1.461s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Lock "cinder-quobyte-14ab3000-4635-4bf8-bb1e-2cf193a91385" released by "delete_snapshot" :: held 1.481s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:03 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Created reservations ['5744381f-547b-470e-a205-f5dd386d9757', '24d7e512-6424-44a8-8af8-7a9bd0d3dd03', 'f08f7a33-25c3-48cb-94d6-3f88cae01e45', 'f78a61e9-1aa1-49cb-8f17-f3ccf809d3a6'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:21:03 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Delete snapshot completed successfully. Sep 04 19:21:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4b4bfbc0-bc31-42d3-a8df-4b2abb4e90f8 tempest-TestStampPattern-777068046 None] Lock "cinder-69c256a5-d71a-4f30-8a9a-498cf28a1d24-delete_snapshot" released by "delete_snapshot" :: held 1.607s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Acquiring lock "cinder-14ab3000-4635-4bf8-bb1e-2cf193a91385-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Lock "cinder-14ab3000-4635-4bf8-bb1e-2cf193a91385-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Acquiring lock "cinder-quobyte-14ab3000-4635-4bf8-bb1e-2cf193a91385" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Lock "cinder-quobyte-14ab3000-4635-4bf8-bb1e-2cf193a91385" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:07 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[34821333-e716-4918-afba-7c0f2e31b3e7]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:08 devstack sudo[104256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 Sep 04 19:21:08 devstack sudo[104256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:08 devstack sudo[104256]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385" returned: 0 in 0.337s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:08 devstack sudo[104261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385 Sep 04 19:21:08 devstack sudo[104261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:08 devstack sudo[104261]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-14ab3000-4635-4bf8-bb1e-2cf193a91385" returned: 0 in 0.230s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Lock "cinder-quobyte-14ab3000-4635-4bf8-bb1e-2cf193a91385" released by "delete_volume" :: held 0.616s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:08 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Created reservations ['fc5f494d-ce98-42c4-b43f-2b6cf73203ca', 'ce825422-0b67-4e6e-b3b8-331936ce479b', '9c5dd2c9-08c9-4218-a045-cf9f6f0f7dab', '889d6248-046d-491f-b8d5-90d8ad5fc173'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:21:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:08 devstack sudo[104264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:21:08 devstack sudo[104264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:08 devstack sudo[104264]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.233s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:08 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:21:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Deleted volume successfully. Sep 04 19:21:08 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-b1b6e468-863f-4d16-9c4d-60a513b65a86 tempest-TestStampPattern-777068046 None] Lock "cinder-14ab3000-4635-4bf8-bb1e-2cf193a91385-delete_volume" released by "delete_volume" :: held 1.023s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:18 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=27,cinder:UPDATE=25,cinder:INSERT=6 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:21:18 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=20,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Flow 'volume_create_manager' (b4a14cbc-3034-40a4-852d-b44c5d8ae10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b828b8-5f64-4f10-b392-d3e2ce5c7ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b828b8-5f64-4f10-b392-d3e2ce5c7ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2006218242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3515c46f-aaf9-42e0-9e4e-12685cb92548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcd88e152f444e9ae716c5e6c845297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:21:20Z,use_quota=True,user_id='d2bd1c30dc4e490c951dc7e6ee5fde9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c927cf50-5d78-47ca-a063-9e65a648393c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c927cf50-5d78-47ca-a063-9e65a648393c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1001957a-062c-481a-8a87-c2d50a9c6f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1001957a-062c-481a-8a87-c2d50a9c6f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3515c46f-aaf9-42e0-9e4e-12685cb92548', 'volume_name': 'volume-3515c46f-aaf9-42e0-9e4e-12685cb92548', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78ae8d9-333c-451c-8d78-88f2c1c0c041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d78ae8d9-333c-451c-8d78-88f2c1c0c041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cea87c9-5431-45b0-ad70-55d504b32903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:19 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume 3515c46f-aaf9-42e0-9e4e-12685cb92548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3515c46f-aaf9-42e0-9e4e-12685cb92548', 'volume_size': 1} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:21:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2006218242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3515c46f-aaf9-42e0-9e4e-12685cb92548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcd88e152f444e9ae716c5e6c845297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:21:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:21:20Z,use_quota=True,user_id='d2bd1c30dc4e490c951dc7e6ee5fde9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Creating volume 3515c46f-aaf9-42e0-9e4e-12685cb92548 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:21:19 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:21:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:19 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 1073741824 Sep 04 19:21:19 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:20 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 1073741824" returned: 0 in 0.377s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:20 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 Sep 04 19:21:20 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:20 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548" returned: 0 in 0.228s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:21:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cea87c9-5431-45b0-ad70-55d504b32903) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3515c46f-aaf9-42e0-9e4e-12685cb92548', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6783d4e8-822b-43ae-b9d7-575a1ed3aab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:20 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 (3515c46f-aaf9-42e0-9e4e-12685cb92548): created successfully Sep 04 19:21:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6783d4e8-822b-43ae-b9d7-575a1ed3aab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:20 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Flow 'volume_create_manager' (b4a14cbc-3034-40a4-852d-b44c5d8ae10e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:21:20 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7940d18a-c613-4914-be56-c724fc4be3cc tempest-CreateVolumesFromSnapshotTest-54078865 None] Created volume successfully. Sep 04 19:21:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] Creating offline snapshot ab80562d-6d9d-4142-bed7-2fd5286d1586 of volume 3515c46f-aaf9-42e0-9e4e-12685cb92548 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:21:20 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4a8830b-aab7-46aa-85cc-7df4ea50b2c8]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:21 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 Sep 04 19:21:21 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:21 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548" returned: 0 in 0.340s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:21 devstack sudo[104285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586 1G Sep 04 19:21:21 devstack sudo[104285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:21 devstack sudo[104285]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586 1G" returned: 0 in 0.362s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:21 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586 Sep 04 19:21:21 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:21 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586" returned: 0 in 0.276s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:21 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586 is being set with open permissions: ugo+rw Sep 04 19:21:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:21 devstack sudo[104297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586 Sep 04 19:21:21 devstack sudo[104297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:22 devstack sudo[104297]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586" returned: 0 in 0.235s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:22 devstack sudo[104300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.info Sep 04 19:21:22 devstack sudo[104300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:22 devstack sudo[104300]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.info" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:22 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.info is being set with open permissions: ugo+rw Sep 04 19:21:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:22 devstack sudo[104303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.info Sep 04 19:21:22 devstack sudo[104303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:22 devstack sudo[104303]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.info" returned: 0 in 0.244s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.795s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:22 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9c90a95c-b4a6-417d-beb0-34c299ec98f3 tempest-CreateVolumesFromSnapshotTest-54078865 None] Create snapshot completed successfully Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Flow 'volume_create_manager' (e8ae0a22-3b08-4a85-acaf-46c695ded0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce010952-d4ac-4695-a586-b78774cfe788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce010952-d4ac-4695-a586-b78774cfe788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1987092473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f1985e-694c-4473-8496-a5b359a846f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcd88e152f444e9ae716c5e6c845297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:21:23Z,use_quota=True,user_id='d2bd1c30dc4e490c951dc7e6ee5fde9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72205c0-d38a-4b20-aadc-f8e25308cb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c72205c0-d38a-4b20-aadc-f8e25308cb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686a8800-7759-4edb-af69-d21f77a45106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (686a8800-7759-4edb-af69-d21f77a45106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f1985e-694c-4473-8496-a5b359a846f3', 'volume_name': 'volume-c6f1985e-694c-4473-8496-a5b359a846f3', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6daa1b83-07f6-40a2-a37d-079b25075fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6daa1b83-07f6-40a2-a37d-079b25075fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d934645-15ce-4071-9415-8909b73c12de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:23 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume c6f1985e-694c-4473-8496-a5b359a846f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f1985e-694c-4473-8496-a5b359a846f3', 'volume_size': 1} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:21:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1987092473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f1985e-694c-4473-8496-a5b359a846f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcd88e152f444e9ae716c5e6c845297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:21:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:21:23Z,use_quota=True,user_id='d2bd1c30dc4e490c951dc7e6ee5fde9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Creating volume c6f1985e-694c-4473-8496-a5b359a846f3 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:21:23 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c6f1985e-694c-4473-8496-a5b359a846f3 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:23 devstack sudo[104306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c6f1985e-694c-4473-8496-a5b359a846f3 1073741824 Sep 04 19:21:23 devstack sudo[104306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Flow 'volume_create_manager' (3618a81c-0e65-43b8-ae1e-446ebdddb513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118de6d0-d2e9-4c75-a9a3-5040a9703dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (118de6d0-d2e9-4c75-a9a3-5040a9703dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2014057972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ed344c-d058-4323-989a-b5fbe3cd5c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcd88e152f444e9ae716c5e6c845297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:21:24Z,use_quota=True,user_id='d2bd1c30dc4e490c951dc7e6ee5fde9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ccac6a-a3ee-4e5d-98b1-2074484c52fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ccac6a-a3ee-4e5d-98b1-2074484c52fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d1846a-299d-48b8-be60-6547294ba090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90d1846a-299d-48b8-be60-6547294ba090) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0ed344c-d058-4323-989a-b5fbe3cd5c02', 'volume_name': 'volume-c0ed344c-d058-4323-989a-b5fbe3cd5c02', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5116d12-81ac-4c91-a5df-293d73df6bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5116d12-81ac-4c91-a5df-293d73df6bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd7a723-3787-4342-a518-f6531c30db7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:23 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume c0ed344c-d058-4323-989a-b5fbe3cd5c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0ed344c-d058-4323-989a-b5fbe3cd5c02', 'volume_size': 1} Sep 04 19:21:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:24 devstack sudo[104306]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c6f1985e-694c-4473-8496-a5b359a846f3 1073741824" returned: 0 in 0.489s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c6f1985e-694c-4473-8496-a5b359a846f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:24 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c6f1985e-694c-4473-8496-a5b359a846f3 Sep 04 19:21:24 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Flow 'volume_create_manager' (7d2bb131-4423-47e6-bec4-a3829722961a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45ae94f-ebf8-432f-88bd-a3977642d04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45ae94f-ebf8-432f-88bd-a3977642d04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1453403771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352fcb89-ddea-4d91-826a-99438f583b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcd88e152f444e9ae716c5e6c845297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:21:24Z,use_quota=True,user_id='d2bd1c30dc4e490c951dc7e6ee5fde9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0acfbcfe-1d46-41e6-928c-96c144141c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0acfbcfe-1d46-41e6-928c-96c144141c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41a44fb-fbc1-4ac8-b39b-8b93be3f3b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c41a44fb-fbc1-4ac8-b39b-8b93be3f3b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '352fcb89-ddea-4d91-826a-99438f583b41', 'volume_name': 'volume-352fcb89-ddea-4d91-826a-99438f583b41', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760f7958-3d86-4b12-9963-4e85df150223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (760f7958-3d86-4b12-9963-4e85df150223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ba773c-4d92-4691-b52f-19e11a72f9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume 352fcb89-ddea-4d91-826a-99438f583b41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-352fcb89-ddea-4d91-826a-99438f583b41', 'volume_size': 1} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:24 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c6f1985e-694c-4473-8496-a5b359a846f3" returned: 0 in 0.289s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.482s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2014057972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0ed344c-d058-4323-989a-b5fbe3cd5c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcd88e152f444e9ae716c5e6c845297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:21:24Z,use_quota=True,user_id='d2bd1c30dc4e490c951dc7e6ee5fde9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Creating volume c0ed344c-d058-4323-989a-b5fbe3cd5c02 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:21:24 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0ed344c-d058-4323-989a-b5fbe3cd5c02 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:24 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0ed344c-d058-4323-989a-b5fbe3cd5c02 1073741824 Sep 04 19:21:24 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d934645-15ce-4071-9415-8909b73c12de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f1985e-694c-4473-8496-a5b359a846f3', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255954ce-074c-401e-8624-ac780c40e40d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume volume-c6f1985e-694c-4473-8496-a5b359a846f3 (c6f1985e-694c-4473-8496-a5b359a846f3): created successfully Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (255954ce-074c-401e-8624-ac780c40e40d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Flow 'volume_create_manager' (e8ae0a22-3b08-4a85-acaf-46c695ded0b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:21:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4817ad02-eb17-4013-bd80-a7a0835afbe0 tempest-CreateVolumesFromSnapshotTest-54078865 None] Created volume successfully. Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Flow 'volume_create_manager' (254625a6-d9b2-4e1f-a547-9540dd60009a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbe740c-2da9-4dde-9d99-fa1ab8ee9121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5cbe740c-2da9-4dde-9d99-fa1ab8ee9121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-510084716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2be152-84c4-432c-9500-5a74f7d1e65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcd88e152f444e9ae716c5e6c845297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:21:25Z,use_quota=True,user_id='d2bd1c30dc4e490c951dc7e6ee5fde9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80623695-5df8-43eb-b830-a4db1247ead8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80623695-5df8-43eb-b830-a4db1247ead8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ddb1a0a-3293-4c75-b0da-b9e6947ae84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ddb1a0a-3293-4c75-b0da-b9e6947ae84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d2be152-84c4-432c-9500-5a74f7d1e65b', 'volume_name': 'volume-3d2be152-84c4-432c-9500-5a74f7d1e65b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eefa341-d59f-4f9e-8c98-82a437efebf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4eefa341-d59f-4f9e-8c98-82a437efebf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0dd00d-d060-4d27-9dd3-c85ab940ae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume 3d2be152-84c4-432c-9500-5a74f7d1e65b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d2be152-84c4-432c-9500-5a74f7d1e65b', 'volume_size': 1} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:24 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0ed344c-d058-4323-989a-b5fbe3cd5c02 1073741824" returned: 0 in 0.399s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0ed344c-d058-4323-989a-b5fbe3cd5c02 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:24 devstack sudo[104321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0ed344c-d058-4323-989a-b5fbe3cd5c02 Sep 04 19:21:24 devstack sudo[104321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:25 devstack sudo[104321]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0ed344c-d058-4323-989a-b5fbe3cd5c02" returned: 0 in 0.285s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.889s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1453403771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=352fcb89-ddea-4d91-826a-99438f583b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcd88e152f444e9ae716c5e6c845297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:21:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:21:24Z,use_quota=True,user_id='d2bd1c30dc4e490c951dc7e6ee5fde9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Creating volume 352fcb89-ddea-4d91-826a-99438f583b41 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:21:25 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-352fcb89-ddea-4d91-826a-99438f583b41 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:25 devstack sudo[104324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-352fcb89-ddea-4d91-826a-99438f583b41 1073741824 Sep 04 19:21:25 devstack sudo[104324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bd7a723-3787-4342-a518-f6531c30db7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0ed344c-d058-4323-989a-b5fbe3cd5c02', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b8a80b5-2e91-4a22-9578-9fe790799113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:25 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume volume-c0ed344c-d058-4323-989a-b5fbe3cd5c02 (c0ed344c-d058-4323-989a-b5fbe3cd5c02): created successfully Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b8a80b5-2e91-4a22-9578-9fe790799113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Flow 'volume_create_manager' (3618a81c-0e65-43b8-ae1e-446ebdddb513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Flow 'volume_create_manager' (37dfcec2-a012-45a5-b7bb-f19ee332ae51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a689a442-6b0f-49cb-afa3-14f6f6a7c871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-35a2ecfc-5b9e-4215-9b3a-4099dfbf72e8 tempest-CreateVolumesFromSnapshotTest-54078865 None] Created volume successfully. Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a689a442-6b0f-49cb-afa3-14f6f6a7c871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-653288081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30eaf87-3f30-459a-815e-3d4fa13a0c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcd88e152f444e9ae716c5e6c845297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:21:25Z,use_quota=True,user_id='d2bd1c30dc4e490c951dc7e6ee5fde9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc69c7bd-e693-4493-a98d-541777d42d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc69c7bd-e693-4493-a98d-541777d42d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac7be63-b4f1-498c-b850-8b7346064667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac7be63-b4f1-498c-b850-8b7346064667) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a30eaf87-3f30-459a-815e-3d4fa13a0c0e', 'volume_name': 'volume-a30eaf87-3f30-459a-815e-3d4fa13a0c0e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9cbb80-927b-418d-ad97-33c6008bd6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c9cbb80-927b-418d-ad97-33c6008bd6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf3f0ba-5701-41bf-b194-23cd55525955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:25 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume a30eaf87-3f30-459a-815e-3d4fa13a0c0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a30eaf87-3f30-459a-815e-3d4fa13a0c0e', 'volume_size': 1} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:25 devstack sudo[104324]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-352fcb89-ddea-4d91-826a-99438f583b41 1073741824" returned: 0 in 0.435s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-352fcb89-ddea-4d91-826a-99438f583b41 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:25 devstack sudo[104330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-352fcb89-ddea-4d91-826a-99438f583b41 Sep 04 19:21:25 devstack sudo[104330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:25 devstack sudo[104330]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-352fcb89-ddea-4d91-826a-99438f583b41" returned: 0 in 0.239s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.213s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-510084716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d2be152-84c4-432c-9500-5a74f7d1e65b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcd88e152f444e9ae716c5e6c845297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:21:25Z,use_quota=True,user_id='d2bd1c30dc4e490c951dc7e6ee5fde9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Creating volume 3d2be152-84c4-432c-9500-5a74f7d1e65b {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:21:25 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3d2be152-84c4-432c-9500-5a74f7d1e65b 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6ba773c-4d92-4691-b52f-19e11a72f9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-352fcb89-ddea-4d91-826a-99438f583b41', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:25 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3d2be152-84c4-432c-9500-5a74f7d1e65b 1073741824 Sep 04 19:21:25 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90975825-5e07-4e1d-b1f2-6286bea6fdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:25 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume volume-352fcb89-ddea-4d91-826a-99438f583b41 (352fcb89-ddea-4d91-826a-99438f583b41): created successfully Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90975825-5e07-4e1d-b1f2-6286bea6fdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Flow 'volume_create_manager' (7d2bb131-4423-47e6-bec4-a3829722961a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:21:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-cebda911-d7ad-4f09-9ef2-c9355dac2c0c tempest-CreateVolumesFromSnapshotTest-54078865 None] Created volume successfully. Sep 04 19:21:26 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3d2be152-84c4-432c-9500-5a74f7d1e65b 1073741824" returned: 0 in 0.440s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3d2be152-84c4-432c-9500-5a74f7d1e65b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:26 devstack sudo[104338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3d2be152-84c4-432c-9500-5a74f7d1e65b Sep 04 19:21:26 devstack sudo[104338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:26 devstack sudo[104338]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3d2be152-84c4-432c-9500-5a74f7d1e65b" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.309s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:21:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-653288081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a30eaf87-3f30-459a-815e-3d4fa13a0c0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bcd88e152f444e9ae716c5e6c845297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:21:25Z,use_quota=True,user_id='d2bd1c30dc4e490c951dc7e6ee5fde9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Creating volume a30eaf87-3f30-459a-815e-3d4fa13a0c0e {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:21:26 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a30eaf87-3f30-459a-815e-3d4fa13a0c0e 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:26 devstack sudo[104341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a30eaf87-3f30-459a-815e-3d4fa13a0c0e 1073741824 Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d0dd00d-d060-4d27-9dd3-c85ab940ae1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d2be152-84c4-432c-9500-5a74f7d1e65b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:26 devstack sudo[104341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fabe024-81ef-4095-a969-29cfc19ef71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:26 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume volume-3d2be152-84c4-432c-9500-5a74f7d1e65b (3d2be152-84c4-432c-9500-5a74f7d1e65b): created successfully Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fabe024-81ef-4095-a969-29cfc19ef71e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Flow 'volume_create_manager' (254625a6-d9b2-4e1f-a547-9540dd60009a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:21:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1893e6fe-f7e3-41ec-9a9c-8b005924c9d1 tempest-CreateVolumesFromSnapshotTest-54078865 None] Created volume successfully. Sep 04 19:21:26 devstack sudo[104341]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a30eaf87-3f30-459a-815e-3d4fa13a0c0e 1073741824" returned: 0 in 0.392s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a30eaf87-3f30-459a-815e-3d4fa13a0c0e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:27 devstack sudo[104347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a30eaf87-3f30-459a-815e-3d4fa13a0c0e Sep 04 19:21:27 devstack sudo[104347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:27 devstack sudo[104347]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a30eaf87-3f30-459a-815e-3d4fa13a0c0e" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bf3f0ba-5701-41bf-b194-23cd55525955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a30eaf87-3f30-459a-815e-3d4fa13a0c0e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62d0bd6-0d60-4573-86da-2f7c54108813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:27 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Volume volume-a30eaf87-3f30-459a-815e-3d4fa13a0c0e (a30eaf87-3f30-459a-815e-3d4fa13a0c0e): created successfully Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e62d0bd6-0d60-4573-86da-2f7c54108813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Flow 'volume_create_manager' (37dfcec2-a012-45a5-b7bb-f19ee332ae51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:21:27 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4b02cb45-a83f-4451-857f-86e5ee31bde4 tempest-CreateVolumesFromSnapshotTest-54078865 None] Created volume successfully. Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "cinder-a30eaf87-3f30-459a-815e-3d4fa13a0c0e-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-a30eaf87-3f30-459a-815e-3d4fa13a0c0e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "cinder-quobyte-a30eaf87-3f30-459a-815e-3d4fa13a0c0e" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-quobyte-a30eaf87-3f30-459a-815e-3d4fa13a0c0e" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf72faa-ee45-4749-84c5-4e364c616c07]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a30eaf87-3f30-459a-815e-3d4fa13a0c0e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:27 devstack sudo[104350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a30eaf87-3f30-459a-815e-3d4fa13a0c0e Sep 04 19:21:27 devstack sudo[104350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:27 devstack sudo[104350]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a30eaf87-3f30-459a-815e-3d4fa13a0c0e" returned: 0 in 0.346s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a30eaf87-3f30-459a-815e-3d4fa13a0c0e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:27 devstack sudo[104355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a30eaf87-3f30-459a-815e-3d4fa13a0c0e Sep 04 19:21:27 devstack sudo[104355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:28 devstack sudo[104355]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-a30eaf87-3f30-459a-815e-3d4fa13a0c0e" returned: 0 in 0.232s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-quobyte-a30eaf87-3f30-459a-815e-3d4fa13a0c0e" released by "delete_volume" :: held 0.613s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Created reservations ['54ebfc5a-2154-48a4-adcc-4aa8ae4a18c4', '2cfc5218-af1e-4d54-9585-4f068772e878', '403ab4b5-574d-4ed4-8d5a-bc7c94448091', '4d4e488f-b293-4f14-8de7-cb5545133358'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:28 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:21:28 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:28 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.240s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:21:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Deleted volume successfully. Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-25719416-7f3d-41f0-95b1-b4be25cd1f4c tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-a30eaf87-3f30-459a-815e-3d4fa13a0c0e-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "cinder-3d2be152-84c4-432c-9500-5a74f7d1e65b-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-3d2be152-84c4-432c-9500-5a74f7d1e65b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "cinder-quobyte-3d2be152-84c4-432c-9500-5a74f7d1e65b" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-quobyte-3d2be152-84c4-432c-9500-5a74f7d1e65b" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca53b9c6-164d-4cf5-b53e-16948b013059]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3d2be152-84c4-432c-9500-5a74f7d1e65b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:28 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3d2be152-84c4-432c-9500-5a74f7d1e65b Sep 04 19:21:28 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:29 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3d2be152-84c4-432c-9500-5a74f7d1e65b" returned: 0 in 0.340s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3d2be152-84c4-432c-9500-5a74f7d1e65b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:29 devstack sudo[104366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3d2be152-84c4-432c-9500-5a74f7d1e65b Sep 04 19:21:29 devstack sudo[104366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:29 devstack sudo[104366]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3d2be152-84c4-432c-9500-5a74f7d1e65b" returned: 0 in 0.240s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-quobyte-3d2be152-84c4-432c-9500-5a74f7d1e65b" released by "delete_volume" :: held 0.616s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Created reservations ['8ab09135-3325-4be5-b8a7-1e3d8ca6e3e8', '50f97ec0-df6f-45d9-8328-e3be0587413c', '889f5867-6100-4de7-b06f-464fbdbef2c8', '1c285924-bfb0-4316-8734-8f77268b9682'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:29 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:21:29 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:29 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.238s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:21:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Deleted volume successfully. Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ef10602c-0f76-4ac4-a103-6ea709c2e914 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-3d2be152-84c4-432c-9500-5a74f7d1e65b-delete_volume" released by "delete_volume" :: held 1.037s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "cinder-352fcb89-ddea-4d91-826a-99438f583b41-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-352fcb89-ddea-4d91-826a-99438f583b41-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "cinder-quobyte-352fcb89-ddea-4d91-826a-99438f583b41" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-quobyte-352fcb89-ddea-4d91-826a-99438f583b41" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0daf54-790c-403d-ac7f-735aaed2450c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-352fcb89-ddea-4d91-826a-99438f583b41 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:29 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-352fcb89-ddea-4d91-826a-99438f583b41 Sep 04 19:21:29 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:30 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-352fcb89-ddea-4d91-826a-99438f583b41" returned: 0 in 0.343s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-352fcb89-ddea-4d91-826a-99438f583b41 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:30 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-352fcb89-ddea-4d91-826a-99438f583b41 Sep 04 19:21:30 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:30 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-352fcb89-ddea-4d91-826a-99438f583b41" returned: 0 in 0.247s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-quobyte-352fcb89-ddea-4d91-826a-99438f583b41" released by "delete_volume" :: held 0.626s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:30 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Created reservations ['1371e856-26b3-45a5-8195-a8baa6b8a3d8', '8eeb6f02-06d3-4258-b762-3a36dc6cdf47', '0818ac5a-ed63-4647-972e-25e24d13a1c4', 'b62d11cc-35e5-474d-9b0b-1fa303a5a706'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:21:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:30 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:21:30 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:30 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:30 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:21:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Deleted volume successfully. Sep 04 19:21:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-34547cc3-6f4f-41a3-872d-c42b6369a865 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-352fcb89-ddea-4d91-826a-99438f583b41-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "cinder-c0ed344c-d058-4323-989a-b5fbe3cd5c02-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-c0ed344c-d058-4323-989a-b5fbe3cd5c02-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "cinder-quobyte-c0ed344c-d058-4323-989a-b5fbe3cd5c02" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-quobyte-c0ed344c-d058-4323-989a-b5fbe3cd5c02" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[732e23da-9087-434e-9683-32b23f8e18ff]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0ed344c-d058-4323-989a-b5fbe3cd5c02 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:31 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0ed344c-d058-4323-989a-b5fbe3cd5c02 Sep 04 19:21:31 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:31 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0ed344c-d058-4323-989a-b5fbe3cd5c02" returned: 0 in 0.336s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0ed344c-d058-4323-989a-b5fbe3cd5c02 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:31 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0ed344c-d058-4323-989a-b5fbe3cd5c02 Sep 04 19:21:31 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:31 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c0ed344c-d058-4323-989a-b5fbe3cd5c02" returned: 0 in 0.230s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-quobyte-c0ed344c-d058-4323-989a-b5fbe3cd5c02" released by "delete_volume" :: held 0.600s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Created reservations ['fa56083b-7823-4231-8818-86994d50eb90', '3326e90f-ab80-4bb2-badb-db6600a80983', 'e4c9af38-2b12-4c7b-a7d9-2bbe704e85dd', 'f33e50a4-3e79-45ac-b078-30d2a42da4d9'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:31 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:21:31 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:31 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.232s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:21:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Deleted volume successfully. Sep 04 19:21:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0d6bf2c-0b93-49e4-9dfa-9d2bc9715dc5 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-c0ed344c-d058-4323-989a-b5fbe3cd5c02-delete_volume" released by "delete_volume" :: held 1.013s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "cinder-c6f1985e-694c-4473-8496-a5b359a846f3-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-c6f1985e-694c-4473-8496-a5b359a846f3-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "cinder-quobyte-c6f1985e-694c-4473-8496-a5b359a846f3" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-quobyte-c6f1985e-694c-4473-8496-a5b359a846f3" acquired by "delete_volume" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c213e8f3-fd85-433a-892b-2772b5309046]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c6f1985e-694c-4473-8496-a5b359a846f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:32 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c6f1985e-694c-4473-8496-a5b359a846f3 Sep 04 19:21:32 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:32 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c6f1985e-694c-4473-8496-a5b359a846f3" returned: 0 in 0.337s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c6f1985e-694c-4473-8496-a5b359a846f3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:32 devstack sudo[104400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c6f1985e-694c-4473-8496-a5b359a846f3 Sep 04 19:21:32 devstack sudo[104400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:32 devstack sudo[104400]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-c6f1985e-694c-4473-8496-a5b359a846f3" returned: 0 in 0.234s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-quobyte-c6f1985e-694c-4473-8496-a5b359a846f3" released by "delete_volume" :: held 0.611s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Created reservations ['4f6d29fe-5e6c-416f-8a6d-babe4d98641d', 'e8eb0073-08ab-4bea-89d7-734ab4f66ca9', 'd5b0d5b5-ce9e-47d4-8d56-6daac637a164', '7a4ff419-7d89-42c7-9a22-560788d95702'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:32 devstack sudo[104403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:21:32 devstack sudo[104403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:33 devstack sudo[104403]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.235s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:21:33 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Deleted volume successfully. Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c2d07aff-85e7-4a8f-9a62-df3892ec7c15 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-c6f1985e-694c-4473-8496-a5b359a846f3-delete_volume" released by "delete_volume" :: held 1.017s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "cinder-ab80562d-6d9d-4142-bed7-2fd5286d1586-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-ab80562d-6d9d-4142-bed7-2fd5286d1586-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "cinder-quobyte-3515c46f-aaf9-42e0-9e4e-12685cb92548" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-quobyte-3515c46f-aaf9-42e0-9e4e-12685cb92548" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "cinder-quobyte-ab80562d-6d9d-4142-bed7-2fd5286d1586" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-quobyte-ab80562d-6d9d-4142-bed7-2fd5286d1586" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Deleting offline snapshot ab80562d-6d9d-4142-bed7-2fd5286d1586 of volume 3515c46f-aaf9-42e0-9e4e-12685cb92548 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] snapshot_file for this snap is: volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad4f9a6-d7b4-4ae2-9900-9bc36c653415]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:33 devstack sudo[104442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586 Sep 04 19:21:33 devstack sudo[104442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:33 devstack sudo[104442]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586" returned: 0 in 0.336s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3515c46f-aaf9-42e0-9e4e-12685cb92548(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd147cf8-6c15-43ed-84a7-dca64f7319fe]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:33 devstack sudo[104447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 Sep 04 19:21:33 devstack sudo[104447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:34 devstack sudo[104447]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548" returned: 0 in 0.334s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:34 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586 Sep 04 19:21:34 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:34 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586" returned: 0 in 0.317s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:34 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586 Sep 04 19:21:34 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:34 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548.ab80562d-6d9d-4142-bed7-2fd5286d1586" returned: 0 in 0.230s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-quobyte-ab80562d-6d9d-4142-bed7-2fd5286d1586" released by "_delete_snapshot" :: held 1.307s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-quobyte-3515c46f-aaf9-42e0-9e4e-12685cb92548" released by "delete_snapshot" :: held 1.333s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:34 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Created reservations ['e6c3e300-a503-439c-af61-053c9c778aea', '354be493-e1de-4942-9775-ebb505520b9d', '0c1682b5-8620-4e9c-b22a-39a1300900ff', '19149cf9-decd-457a-b2c8-e13e189df0d9'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:21:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Delete snapshot completed successfully. Sep 04 19:21:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a0c8fd4b-8115-4a81-ab9b-20014b0ce492 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-ab80562d-6d9d-4142-bed7-2fd5286d1586-delete_snapshot" released by "delete_snapshot" :: held 1.457s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "cinder-3515c46f-aaf9-42e0-9e4e-12685cb92548-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-3515c46f-aaf9-42e0-9e4e-12685cb92548-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "cinder-quobyte-3515c46f-aaf9-42e0-9e4e-12685cb92548" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-quobyte-3515c46f-aaf9-42e0-9e4e-12685cb92548" acquired by "delete_volume" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:35 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a48a93-5f2d-4ef2-a8f1-cffc6adea771]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:35 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 Sep 04 19:21:35 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:35 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548" returned: 0 in 0.343s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:35 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548 Sep 04 19:21:35 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:36 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3515c46f-aaf9-42e0-9e4e-12685cb92548" returned: 0 in 0.238s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-quobyte-3515c46f-aaf9-42e0-9e4e-12685cb92548" released by "delete_volume" :: held 0.629s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:36 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Created reservations ['83dce7b6-ac04-4a54-a88d-7d7e5af24c44', '3e2d00e3-fd21-47f2-a546-adc3c654e3f1', '7b9ad24e-b9a9-4e26-a010-897027a684b4', 'aab50c98-7be4-4cfd-aa25-4013cc1c4f00'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:21:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:36 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:21:36 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:36 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.225s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:36 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:21:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Deleted volume successfully. Sep 04 19:21:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-51229336-8692-4017-8ccc-e2e79a14b523 tempest-CreateVolumesFromSnapshotTest-54078865 None] Lock "cinder-3515c46f-aaf9-42e0-9e4e-12685cb92548-delete_volume" released by "delete_volume" :: held 1.039s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:41 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:21:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Flow 'volume_create_manager' (7250aad6-36e2-44a2-a0e0-2aa5f950157e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:21:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0aa8ef9-d750-43b5-8a55-60d04ddd173f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0aa8ef9-d750-43b5-8a55-60d04ddd173f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2239503f-dbe3-423b-94e5-07bd793d7e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525ca4efa342407d845e6f8c31f49c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:21:41Z,use_quota=True,user_id='7be6075ca46c4bb89376145eeab37ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62856136-94cb-4475-b025-cc755b6defad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62856136-94cb-4475-b025-cc755b6defad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b60c6cb-1362-4d32-a9fa-b66b055f5ed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:41 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 19:21:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b60c6cb-1362-4d32-a9fa-b66b055f5ed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2239503f-dbe3-423b-94e5-07bd793d7e7d', 'volume_name': 'volume-2239503f-dbe3-423b-94e5-07bd793d7e7d', 'volume_size': 1, 'image_id': 'b6980ef8-9cca-43df-98c0-59d197db2ff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6980ef8-9cca-43df-98c0-59d197db2ff1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b163b40abb49b23a7eef0f47c921a3be', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '525ca4efa342407d845e6f8c31f49c2d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '12e958a35db3c3795053c5c2585210bdf819d5a205ec348b4ca9e71b46c7d85696b8c8e92a694f27813fbf9dd199f8bc33760bb63373c47cc599fb424f676f55', 'id': 'b6980ef8-9cca-43df-98c0-59d197db2ff1', 'created_at': datetime.datetime(2026, 9, 4, 17, 21, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 17, 21, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6980ef8-9cca-43df-98c0-59d197db2ff1/file', 'properties': {}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fa2e31-5d10-4a34-9feb-2566e1e9209e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fa2e31-5d10-4a34-9feb-2566e1e9209e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:41 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5117c7-ba87-4319-8ff2-bb40d02cdcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:41 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Volume 2239503f-dbe3-423b-94e5-07bd793d7e7d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2239503f-dbe3-423b-94e5-07bd793d7e7d', 'volume_size': 1, 'image_id': 'b6980ef8-9cca-43df-98c0-59d197db2ff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6980ef8-9cca-43df-98c0-59d197db2ff1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b163b40abb49b23a7eef0f47c921a3be', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '525ca4efa342407d845e6f8c31f49c2d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '12e958a35db3c3795053c5c2585210bdf819d5a205ec348b4ca9e71b46c7d85696b8c8e92a694f27813fbf9dd199f8bc33760bb63373c47cc599fb424f676f55', 'id': 'b6980ef8-9cca-43df-98c0-59d197db2ff1', 'created_at': datetime.datetime(2026, 9, 4, 17, 21, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 17, 21, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6980ef8-9cca-43df-98c0-59d197db2ff1/file', 'properties': {}}, 'image_service': } Sep 04 19:21:41 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Trying to clone 2239503f-dbe3-423b-94e5-07bd793d7e7d from image b6980ef8-9cca-43df-98c0-59d197db2ff1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b6980ef8-9cca-43df-98c0-59d197db2ff1', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 19:21:41 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 19:21:41 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Image download 0.00 MB at 0.00 MB/s Sep 04 19:21:41 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[99fc0d39-8f78-4c48-9f9a-be81f90ad862]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:41 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD Sep 04 19:21:41 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:42 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD" returned: 0 in 0.321s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:42 devstack sudo[104480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD Sep 04 19:21:42 devstack sudo[104480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:42 devstack sudo[104480]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD" returned: 1 in 0.316s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:21:42 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Temporary image b6980ef8-9cca-43df-98c0-59d197db2ff1 is fetched for user 7be6075ca46c4bb89376145eeab37ec2. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 19:21:42 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e2546d-6db1-4c70-8c3b-b9bd3e1b62a8]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:42 devstack sudo[104485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD Sep 04 19:21:42 devstack sudo[104485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:42 devstack sudo[104485]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:42 devstack sudo[104489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD Sep 04 19:21:42 devstack sudo[104489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:43 devstack sudo[104489]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:21:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2239503f-dbe3-423b-94e5-07bd793d7e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='525ca4efa342407d845e6f8c31f49c2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:21:41Z,use_quota=True,user_id='7be6075ca46c4bb89376145eeab37ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Creating volume 2239503f-dbe3-423b-94e5-07bd793d7e7d {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:21:43 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:43 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d 1073741824 Sep 04 19:21:43 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:43 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d 1073741824" returned: 0 in 0.408s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:43 devstack sudo[104499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d Sep 04 19:21:43 devstack sudo[104499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:43 devstack sudo[104499]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d" returned: 0 in 0.234s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.683s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Attempting download of b6980ef8-9cca-43df-98c0-59d197db2ff1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b6980ef8-9cca-43df-98c0-59d197db2ff1', 'metadata': {}}])) to volume 2239503f-dbe3-423b-94e5-07bd793d7e7d. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f16669-ab65-4708-9d37-535f2f4b1942]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6980ef8-9cca-43df-98c0-59d197db2ff1_z0gwp9gr {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:43 devstack sudo[104502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6980ef8-9cca-43df-98c0-59d197db2ff1_z0gwp9gr Sep 04 19:21:43 devstack sudo[104502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:44 devstack sudo[104502]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b6980ef8-9cca-43df-98c0-59d197db2ff1_z0gwp9gr" returned: 0 in 0.325s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6980ef8-9cca-43df-98c0-59d197db2ff1_z0gwp9gr {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:44 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6980ef8-9cca-43df-98c0-59d197db2ff1_z0gwp9gr Sep 04 19:21:44 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:44 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6980ef8-9cca-43df-98c0-59d197db2ff1_z0gwp9gr" returned: 1 in 0.310s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b6980ef8-9cca-43df-98c0-59d197db2ff1_z0gwp9gr' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:21:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba05c422-a81c-478c-bebb-d77cb49e66ff]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:44 devstack sudo[104510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD Sep 04 19:21:44 devstack sudo[104510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:44 devstack sudo[104510]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:44 devstack sudo[104514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD Sep 04 19:21:44 devstack sudo[104514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:45 devstack sudo[104514]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD" returned: 1 in 0.314s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] b6980ef8-9cca-43df-98c0-59d197db2ff1 was raw, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:45 devstack sudo[104519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d Sep 04 19:21:45 devstack sudo[104519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:45 devstack sudo[104521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:21:45 devstack sudo[104521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:45 devstack sudo[104521]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.236s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:21:45 devstack sudo[104519]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d" returned: 0 in 0.452s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b6980ef8-9cca-43df-98c0-59d197db2ff1_hts6by5cdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:21:45 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:45 devstack sudo[104528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d 1G Sep 04 19:21:45 devstack sudo[104528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:45 devstack sudo[104528]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d 1G" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Downloaded image b6980ef8-9cca-43df-98c0-59d197db2ff1 ((None, [{'url': 'file:///opt/stack/data/glance/images/b6980ef8-9cca-43df-98c0-59d197db2ff1', 'metadata': {}}])) to volume 2239503f-dbe3-423b-94e5-07bd793d7e7d successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Temporary image b6980ef8-9cca-43df-98c0-59d197db2ff1 for user 7be6075ca46c4bb89376145eeab37ec2 is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Marking volume 2239503f-dbe3-423b-94e5-07bd793d7e7d as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Copying metadata from image b6980ef8-9cca-43df-98c0-59d197db2ff1 to 2239503f-dbe3-423b-94e5-07bd793d7e7d. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Creating volume glance metadata for volume 2239503f-dbe3-423b-94e5-07bd793d7e7d backed by image b6980ef8-9cca-43df-98c0-59d197db2ff1 with: {'image_id': 'b6980ef8-9cca-43df-98c0-59d197db2ff1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b163b40abb49b23a7eef0f47c921a3be', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa5117c7-ba87-4319-8ff2-bb40d02cdcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2239503f-dbe3-423b-94e5-07bd793d7e7d', 'volume_size': 1, 'image_id': 'b6980ef8-9cca-43df-98c0-59d197db2ff1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b6980ef8-9cca-43df-98c0-59d197db2ff1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b163b40abb49b23a7eef0f47c921a3be', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '525ca4efa342407d845e6f8c31f49c2d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '12e958a35db3c3795053c5c2585210bdf819d5a205ec348b4ca9e71b46c7d85696b8c8e92a694f27813fbf9dd199f8bc33760bb63373c47cc599fb424f676f55', 'id': 'b6980ef8-9cca-43df-98c0-59d197db2ff1', 'created_at': datetime.datetime(2026, 9, 4, 17, 21, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 17, 21, 40, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b6980ef8-9cca-43df-98c0-59d197db2ff1/file', 'properties': {}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a68704-b0c0-43f6-82de-490677a609f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:21:45 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Volume volume-2239503f-dbe3-423b-94e5-07bd793d7e7d (2239503f-dbe3-423b-94e5-07bd793d7e7d): created successfully Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a68704-b0c0-43f6-82de-490677a609f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:21:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Flow 'volume_create_manager' (7250aad6-36e2-44a2-a0e0-2aa5f950157e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:21:45 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9993ffc0-6cd2-4de1-87de-e11b9216698b tempest-VolumeImageDependencyTests-297130266 None] Created volume successfully. Sep 04 19:21:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Acquiring lock "cinder-2239503f-dbe3-423b-94e5-07bd793d7e7d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Lock "cinder-2239503f-dbe3-423b-94e5-07bd793d7e7d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Acquiring lock "cinder-quobyte-2239503f-dbe3-423b-94e5-07bd793d7e7d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:21:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Lock "cinder-quobyte-2239503f-dbe3-423b-94e5-07bd793d7e7d" acquired by "delete_volume" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:21:46 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[96064016-15ab-4186-be25-e9d0c7997fe7]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:21:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:46 devstack sudo[104533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d Sep 04 19:21:46 devstack sudo[104533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:47 devstack sudo[104533]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d" returned: 0 in 0.345s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:47 devstack sudo[104538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d Sep 04 19:21:47 devstack sudo[104538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:47 devstack sudo[104538]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2239503f-dbe3-423b-94e5-07bd793d7e7d" returned: 0 in 0.240s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Lock "cinder-quobyte-2239503f-dbe3-423b-94e5-07bd793d7e7d" released by "delete_volume" :: held 0.626s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:47 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Created reservations ['49fd6a8a-bd88-4a92-9510-66baed754c74', '3ecfba2c-b814-4c15-a5f7-a19609751124', 'a5537c38-4930-47d8-ad63-6efe2b9d7b58', '4f54de7d-acd0-4c73-abe7-0ddb21c71b0b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:21:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:21:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:21:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:21:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:21:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:21:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:21:47 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:21:47 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:21:47 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Sep 04 19:21:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.241s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:21:47 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:21:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Deleted volume successfully. Sep 04 19:21:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-189e8e07-0232-4ffb-b2b8-1872befc2a4a tempest-VolumeImageDependencyTests-297130266 None] Lock "cinder-2239503f-dbe3-423b-94e5-07bd793d7e7d-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:21:57 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=58,cinder:UPDATE=83,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:21:57 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=88,cinder:SELECT=69,cinder:INSERT=24,cinder:DELETE=8 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:22:03 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Flow 'volume_create_manager' (2b8b5783-6afe-42b1-83c8-c058374c7a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0cc1782-6825-4d9c-bb8a-cccc536e8c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0cc1782-6825-4d9c-bb8a-cccc536e8c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1983420734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0dd0210-57d6-449f-9fc3-573f492782af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faadc5c31efb4e95a08fc7a6720bdc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:04Z,use_quota=True,user_id='34829fdc820747f99554bf0489bb2df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0569f039-ea11-43f9-a8bf-78e437ced39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0569f039-ea11-43f9-a8bf-78e437ced39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b33133-e4e3-4764-9464-d9e7f4eb6088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5b33133-e4e3-4764-9464-d9e7f4eb6088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0dd0210-57d6-449f-9fc3-573f492782af', 'volume_name': 'volume-d0dd0210-57d6-449f-9fc3-573f492782af', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ce6721-934b-42a0-8f44-62fdeef302ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4ce6721-934b-42a0-8f44-62fdeef302ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4166ef8f-1ce8-4d32-be91-5a4c96faf814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:04 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Volume d0dd0210-57d6-449f-9fc3-573f492782af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0dd0210-57d6-449f-9fc3-573f492782af', 'volume_size': 1} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1983420734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0dd0210-57d6-449f-9fc3-573f492782af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faadc5c31efb4e95a08fc7a6720bdc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:04Z,use_quota=True,user_id='34829fdc820747f99554bf0489bb2df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Creating volume d0dd0210-57d6-449f-9fc3-573f492782af {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:04 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d0dd0210-57d6-449f-9fc3-573f492782af 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:04 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d0dd0210-57d6-449f-9fc3-573f492782af 1073741824 Sep 04 19:22:04 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Flow 'volume_create_manager' (a33376ea-f373-4e99-8ffc-1a48e24ba1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7595e82c-b3ed-4699-afb7-722ab1d29ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7595e82c-b3ed-4699-afb7-722ab1d29ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-241392880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26c3a5e-56d3-4825-9f8f-936a4b82e500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faadc5c31efb4e95a08fc7a6720bdc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:04Z,use_quota=True,user_id='34829fdc820747f99554bf0489bb2df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe9b8ef-136e-4966-9f6e-e39e31f19c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe9b8ef-136e-4966-9f6e-e39e31f19c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f4cf68-4122-4b73-ae8e-75aee5f60999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f4cf68-4122-4b73-ae8e-75aee5f60999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b26c3a5e-56d3-4825-9f8f-936a4b82e500', 'volume_name': 'volume-b26c3a5e-56d3-4825-9f8f-936a4b82e500', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bed02e3-7988-44e3-bf4a-315412546087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bed02e3-7988-44e3-bf4a-315412546087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5469f326-c494-4300-8b29-f08faa5914a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:04 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Volume b26c3a5e-56d3-4825-9f8f-936a4b82e500: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b26c3a5e-56d3-4825-9f8f-936a4b82e500', 'volume_size': 1} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Flow 'volume_create_manager' (907d9260-100f-45a1-8c67-6e824c0069f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25af83f7-6eff-4444-aa8c-b17d95f32201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25af83f7-6eff-4444-aa8c-b17d95f32201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1926993752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036e2a92-d013-47ed-b047-9a9efeb9c509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0de716ff4344729617ade657ab2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:05Z,use_quota=True,user_id='09f4f217fea1418faa57179cd5b90e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531f41b3-5300-479d-aed3-e73bb567e345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (531f41b3-5300-479d-aed3-e73bb567e345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5da4dba-9576-4233-bc1c-c289b97e195c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5da4dba-9576-4233-bc1c-c289b97e195c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '036e2a92-d013-47ed-b047-9a9efeb9c509', 'volume_name': 'volume-036e2a92-d013-47ed-b047-9a9efeb9c509', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8fd3148-4102-4be9-85ab-4336276ff8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8fd3148-4102-4be9-85ab-4336276ff8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d2ea0b-9c07-4b76-9bef-596cbedb8540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:04 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume 036e2a92-d013-47ed-b047-9a9efeb9c509: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-036e2a92-d013-47ed-b047-9a9efeb9c509', 'volume_size': 1} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:04 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Flow 'volume_create_manager' (3d800c28-1901-47d0-ba94-36f87a6dd2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745a164a-cee2-4f9b-a858-e5c5a9a97e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d0dd0210-57d6-449f-9fc3-573f492782af 1073741824" returned: 0 in 0.756s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (745a164a-cee2-4f9b-a858-e5c5a9a97e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1302869303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6adcd4a-82ec-47e6-bbd4-376e295ef1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faadc5c31efb4e95a08fc7a6720bdc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:05Z,use_quota=True,user_id='34829fdc820747f99554bf0489bb2df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:04 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6f524b-ec98-4421-9a30-62bb01558606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6f524b-ec98-4421-9a30-62bb01558606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c8640c-2a4a-4787-a4b0-5ccbb33b296a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c8640c-2a4a-4787-a4b0-5ccbb33b296a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6adcd4a-82ec-47e6-bbd4-376e295ef1e3', 'volume_name': 'volume-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d46881-a71c-4801-8b30-c86648d0d9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d46881-a71c-4801-8b30-c86648d0d9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f772ad27-8de5-4202-a51c-6ae4c520d6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:05 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Volume f6adcd4a-82ec-47e6-bbd4-376e295ef1e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3', 'volume_size': 1} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d0dd0210-57d6-449f-9fc3-573f492782af {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:05 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d0dd0210-57d6-449f-9fc3-573f492782af Sep 04 19:22:05 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:05 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d0dd0210-57d6-449f-9fc3-573f492782af" returned: 0 in 0.391s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.993s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-241392880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26c3a5e-56d3-4825-9f8f-936a4b82e500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faadc5c31efb4e95a08fc7a6720bdc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:04Z,use_quota=True,user_id='34829fdc820747f99554bf0489bb2df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Creating volume b26c3a5e-56d3-4825-9f8f-936a4b82e500 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:05 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b26c3a5e-56d3-4825-9f8f-936a4b82e500 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:05 devstack sudo[104601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b26c3a5e-56d3-4825-9f8f-936a4b82e500 1073741824 Sep 04 19:22:05 devstack sudo[104601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4166ef8f-1ce8-4d32-be91-5a4c96faf814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0dd0210-57d6-449f-9fc3-573f492782af', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef17d5e6-f21c-4e72-9849-033ac593a68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:05 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Volume volume-d0dd0210-57d6-449f-9fc3-573f492782af (d0dd0210-57d6-449f-9fc3-573f492782af): created successfully Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef17d5e6-f21c-4e72-9849-033ac593a68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Flow 'volume_create_manager' (2b8b5783-6afe-42b1-83c8-c058374c7a2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:05 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-005d20de-a112-48d3-88d1-e39dc15620cd tempest-CreateVolumesFromImageTest-775495669 None] Created volume successfully. Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Flow 'volume_create_manager' (782f0ea1-8890-41a9-8f41-823b20cdd47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec8c090-8b6d-4fc5-ba7c-dd6aabe91296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eec8c090-8b6d-4fc5-ba7c-dd6aabe91296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1625527777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f95472c-1b8f-47b8-8c3c-24c9bf0507e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ceb5502ee74a2c839ba13e9529e50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:06Z,use_quota=True,user_id='207d38169f8a4c6cbd002d68a305acbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ebc4195-04b4-48ce-973b-39f56ca1f4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ebc4195-04b4-48ce-973b-39f56ca1f4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186caf44-e24e-42ec-a903-17bb4d2c7409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (186caf44-e24e-42ec-a903-17bb4d2c7409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f95472c-1b8f-47b8-8c3c-24c9bf0507e4', 'volume_name': 'volume-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91bf9f2a-cba7-45d0-8902-a8e5f5cb860c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91bf9f2a-cba7-45d0-8902-a8e5f5cb860c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8791a44b-1cc2-498d-a522-075cb25ae056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:05 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Volume 8f95472c-1b8f-47b8-8c3c-24c9bf0507e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4', 'volume_size': 1} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Flow 'volume_create_manager' (99b4d6a7-6570-42a5-811b-bf34e9bbd167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6352679d-b858-45b7-9995-6152b089e938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6352679d-b858-45b7-9995-6152b089e938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-891149489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7363a582-33de-45b0-9e9a-24d366683748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faadc5c31efb4e95a08fc7a6720bdc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:06Z,use_quota=True,user_id='34829fdc820747f99554bf0489bb2df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d53fe9-6356-40a2-a616-5dae6a1ed93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d53fe9-6356-40a2-a616-5dae6a1ed93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63063365-2483-481a-ac00-1772e4ded4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63063365-2483-481a-ac00-1772e4ded4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7363a582-33de-45b0-9e9a-24d366683748', 'volume_name': 'volume-7363a582-33de-45b0-9e9a-24d366683748', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a907c8-a25b-4308-b416-5a4483aebc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a907c8-a25b-4308-b416-5a4483aebc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93f69c5-eac4-4ce3-ad97-b88e2a87192e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:05 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Volume 7363a582-33de-45b0-9e9a-24d366683748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7363a582-33de-45b0-9e9a-24d366683748', 'volume_size': 1} Sep 04 19:22:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Flow 'volume_create_manager' (fed8511b-36ce-49f0-a38f-d8638b48587b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533581bb-3e8d-4fb6-a274-4742abeca720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (533581bb-3e8d-4fb6-a274-4742abeca720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1667496054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1120e9-a6b4-48e7-ad78-bf1034c79f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faadc5c31efb4e95a08fc7a6720bdc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:06Z,use_quota=True,user_id='34829fdc820747f99554bf0489bb2df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bcd5415-221a-4442-9f3e-015c9deb929e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bcd5415-221a-4442-9f3e-015c9deb929e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23926cf0-3050-40e2-9037-b9414608e378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:06 devstack sudo[104601]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23926cf0-3050-40e2-9037-b9414608e378) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f1120e9-a6b4-48e7-ad78-bf1034c79f92', 'volume_name': 'volume-2f1120e9-a6b4-48e7-ad78-bf1034c79f92', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59194a4b-be46-4bdc-9d73-a8d17f3e1745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59194a4b-be46-4bdc-9d73-a8d17f3e1745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8822177-04fc-4e93-90a0-99dd2b7020d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:06 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Volume 2f1120e9-a6b4-48e7-ad78-bf1034c79f92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f1120e9-a6b4-48e7-ad78-bf1034c79f92', 'volume_size': 1} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b26c3a5e-56d3-4825-9f8f-936a4b82e500 1073741824" returned: 0 in 0.617s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b26c3a5e-56d3-4825-9f8f-936a4b82e500 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:06 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b26c3a5e-56d3-4825-9f8f-936a4b82e500 Sep 04 19:22:06 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:06 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b26c3a5e-56d3-4825-9f8f-936a4b82e500" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.539s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1926993752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=036e2a92-d013-47ed-b047-9a9efeb9c509,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0de716ff4344729617ade657ab2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:05Z,use_quota=True,user_id='09f4f217fea1418faa57179cd5b90e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Creating volume 036e2a92-d013-47ed-b047-9a9efeb9c509 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:06 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:06 devstack sudo[104610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509 1073741824 Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5469f326-c494-4300-8b29-f08faa5914a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b26c3a5e-56d3-4825-9f8f-936a4b82e500', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:06 devstack sudo[104610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb28865-cd16-4241-83e7-23d03bdacfbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:06 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Volume volume-b26c3a5e-56d3-4825-9f8f-936a4b82e500 (b26c3a5e-56d3-4825-9f8f-936a4b82e500): created successfully Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bb28865-cd16-4241-83e7-23d03bdacfbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Flow 'volume_create_manager' (a33376ea-f373-4e99-8ffc-1a48e24ba1b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-013871b2-73d3-40e5-b09e-d4332e24f7f8 tempest-CreateVolumesFromImageTest-775495669 None] Created volume successfully. Sep 04 19:22:06 devstack sudo[104610]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509 1073741824" returned: 0 in 0.423s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:06 devstack sudo[104616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509 Sep 04 19:22:06 devstack sudo[104616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:07 devstack sudo[104616]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509" returned: 0 in 0.284s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.116s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1302869303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6adcd4a-82ec-47e6-bbd4-376e295ef1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faadc5c31efb4e95a08fc7a6720bdc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:05Z,use_quota=True,user_id='34829fdc820747f99554bf0489bb2df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Creating volume f6adcd4a-82ec-47e6-bbd4-376e295ef1e3 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:07 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72d2ea0b-9c07-4b76-9bef-596cbedb8540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-036e2a92-d013-47ed-b047-9a9efeb9c509', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:07 devstack sudo[104619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3 1073741824 Sep 04 19:22:07 devstack sudo[104619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f067ce-1da3-4002-aca9-ab51cf90cc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:07 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume volume-036e2a92-d013-47ed-b047-9a9efeb9c509 (036e2a92-d013-47ed-b047-9a9efeb9c509): created successfully Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51f067ce-1da3-4002-aca9-ab51cf90cc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Flow 'volume_create_manager' (907d9260-100f-45a1-8c67-6e824c0069f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-579df145-44bf-43ee-84af-552825cc64ed tempest-CreateVolumesFromSnapshotTest-325442251 None] Created volume successfully. Sep 04 19:22:07 devstack sudo[104619]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3 1073741824" returned: 0 in 0.475s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:07 devstack sudo[104625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3 Sep 04 19:22:07 devstack sudo[104625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:07 devstack sudo[104625]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.151s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1625527777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f95472c-1b8f-47b8-8c3c-24c9bf0507e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ceb5502ee74a2c839ba13e9529e50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:06Z,use_quota=True,user_id='207d38169f8a4c6cbd002d68a305acbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Creating volume 8f95472c-1b8f-47b8-8c3c-24c9bf0507e4 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:07 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f772ad27-8de5-4202-a51c-6ae4c520d6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80b1a81-7b35-4106-af4a-b2597e4405fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:07 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4 1073741824 Sep 04 19:22:07 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:07 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Volume volume-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3 (f6adcd4a-82ec-47e6-bbd4-376e295ef1e3): created successfully Sep 04 19:22:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e80b1a81-7b35-4106-af4a-b2597e4405fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Flow 'volume_create_manager' (3d800c28-1901-47d0-ba94-36f87a6dd2b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-bc58a837-3f97-4cfd-808a-01a7c5399f1e tempest-CreateVolumesFromImageTest-775495669 None] Created volume successfully. Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Flow 'volume_create_manager' (9929afd9-62b8-4ce4-b393-08fc3804b75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016678cf-ede8-4cd6-8141-f8a698d1f31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016678cf-ede8-4cd6-8141-f8a698d1f31c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595f9f18-29dc-40e3-9f68-8f2f5f4afc2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40ee4681c12e4bc49d51518878296166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:08Z,use_quota=True,user_id='b2667b008076421ab9859187ef3053b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d8a31cd-d390-43ef-b5f1-465f8bbb0299),volume_type_id=9d8a31cd-d390-43ef-b5f1-465f8bbb0299)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2431a376-1798-4bde-8901-39c6ea0d0ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2431a376-1798-4bde-8901-39c6ea0d0ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a45a2dd0-8177-4174-80c9-9e1012819caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:08 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4 1073741824" returned: 0 in 0.536s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:08 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4 Sep 04 19:22:08 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a45a2dd0-8177-4174-80c9-9e1012819caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '595f9f18-29dc-40e3-9f68-8f2f5f4afc2f', 'volume_name': 'volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f', 'volume_size': 1, 'image_id': '920d9a96-8753-42e9-9a87-4ac6d76aded2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/920d9a96-8753-42e9-9a87-4ac6d76aded2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ee69f34cefb4b3653494260eba8bbf1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '40ee4681c12e4bc49d51518878296166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3403716a1e121a22e9b3c90cba6b56f94fbc06e91c1b65dd8b3c66299f755f4094c7d41c1bcfd9d14b1540b8734c080c5dc937d57a345d0008fc2f8e54b1bd14', 'id': '920d9a96-8753-42e9-9a87-4ac6d76aded2', 'created_at': datetime.datetime(2026, 9, 4, 17, 22, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 17, 22, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/920d9a96-8753-42e9-9a87-4ac6d76aded2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03daeb1a-6f64-4186-9265-06b085ab0b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03daeb1a-6f64-4186-9265-06b085ab0b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6477a3a-8085-4850-a3e5-935f10a2c8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:08 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Volume 595f9f18-29dc-40e3-9f68-8f2f5f4afc2f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f', 'volume_size': 1, 'image_id': '920d9a96-8753-42e9-9a87-4ac6d76aded2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/920d9a96-8753-42e9-9a87-4ac6d76aded2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ee69f34cefb4b3653494260eba8bbf1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '40ee4681c12e4bc49d51518878296166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3403716a1e121a22e9b3c90cba6b56f94fbc06e91c1b65dd8b3c66299f755f4094c7d41c1bcfd9d14b1540b8734c080c5dc937d57a345d0008fc2f8e54b1bd14', 'id': '920d9a96-8753-42e9-9a87-4ac6d76aded2', 'created_at': datetime.datetime(2026, 9, 4, 17, 22, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 17, 22, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/920d9a96-8753-42e9-9a87-4ac6d76aded2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Trying to clone 595f9f18-29dc-40e3-9f68-8f2f5f4afc2f from image 920d9a96-8753-42e9-9a87-4ac6d76aded2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/920d9a96-8753-42e9-9a87-4ac6d76aded2', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 19:22:08 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Image download 0.00 MB at 0.00 MB/s Sep 04 19:22:08 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4" returned: 0 in 0.253s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.843s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-891149489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7363a582-33de-45b0-9e9a-24d366683748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faadc5c31efb4e95a08fc7a6720bdc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:06Z,use_quota=True,user_id='34829fdc820747f99554bf0489bb2df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Creating volume 7363a582-33de-45b0-9e9a-24d366683748 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:08 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7363a582-33de-45b0-9e9a-24d366683748 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[577fbbb0-7434-4ce3-a12b-7953edcc3283]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:08 devstack sudo[104637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7363a582-33de-45b0-9e9a-24d366683748 1073741824 Sep 04 19:22:08 devstack sudo[104637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8791a44b-1cc2-498d-a522-075cb25ae056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639d3c1a-b14d-4d0b-902f-d2a38c9c3855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:08 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Volume volume-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4 (8f95472c-1b8f-47b8-8c3c-24c9bf0507e4): created successfully Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (639d3c1a-b14d-4d0b-902f-d2a38c9c3855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:08 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Flow 'volume_create_manager' (782f0ea1-8890-41a9-8f41-823b20cdd47a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:08 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0f4ff428-1d90-42c1-b8ef-081fe2991fc9 tempest-ProjectReaderTests-1611379847 None] Created volume successfully. Sep 04 19:22:08 devstack sudo[104638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD Sep 04 19:22:08 devstack sudo[104638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:09 devstack sudo[104638]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:09 devstack sudo[104637]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7363a582-33de-45b0-9e9a-24d366683748 1073741824" returned: 0 in 0.442s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7363a582-33de-45b0-9e9a-24d366683748 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:09 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD Sep 04 19:22:09 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:09 devstack sudo[104648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7363a582-33de-45b0-9e9a-24d366683748 Sep 04 19:22:09 devstack sudo[104648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:09 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Temporary image 920d9a96-8753-42e9-9a87-4ac6d76aded2 is fetched for user b2667b008076421ab9859187ef3053b9. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 19:22:09 devstack sudo[104648]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7363a582-33de-45b0-9e9a-24d366683748" returned: 0 in 0.272s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.449s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1667496054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1120e9-a6b4-48e7-ad78-bf1034c79f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='faadc5c31efb4e95a08fc7a6720bdc03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:06Z,use_quota=True,user_id='34829fdc820747f99554bf0489bb2df8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Creating volume 2f1120e9-a6b4-48e7-ad78-bf1034c79f92 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:09 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2f1120e9-a6b4-48e7-ad78-bf1034c79f92 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:09 devstack sudo[104655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2f1120e9-a6b4-48e7-ad78-bf1034c79f92 1073741824 Sep 04 19:22:09 devstack sudo[104655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93f69c5-eac4-4ce3-ad97-b88e2a87192e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7363a582-33de-45b0-9e9a-24d366683748', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84efaf8f-8e15-4a04-88c3-012d58d92f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:09 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Volume volume-7363a582-33de-45b0-9e9a-24d366683748 (7363a582-33de-45b0-9e9a-24d366683748): created successfully Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84efaf8f-8e15-4a04-88c3-012d58d92f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Flow 'volume_create_manager' (99b4d6a7-6570-42a5-811b-bf34e9bbd167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-abb6c643-d29c-4f82-9f7e-be0a45a47bf1 tempest-CreateVolumesFromImageTest-775495669 None] Created volume successfully. Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[51434146-c84a-4efd-8211-389e4944773b]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Acquiring lock "cinder-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Lock "cinder-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Acquiring lock "cinder-quobyte-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:09 devstack sudo[104657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD Sep 04 19:22:09 devstack sudo[104657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Lock "cinder-quobyte-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8658a462-4e9a-4c0e-82fa-4af0f4934796]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:09 devstack sudo[104662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4 Sep 04 19:22:09 devstack sudo[104662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:10 devstack sudo[104657]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:10 devstack sudo[104655]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2f1120e9-a6b4-48e7-ad78-bf1034c79f92 1073741824" returned: 0 in 0.467s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2f1120e9-a6b4-48e7-ad78-bf1034c79f92 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:10 devstack sudo[104668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2f1120e9-a6b4-48e7-ad78-bf1034c79f92 Sep 04 19:22:10 devstack sudo[104668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:10 devstack sudo[104667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD Sep 04 19:22:10 devstack sudo[104667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:10 devstack sudo[104662]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4" returned: 0 in 0.389s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:10 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4 Sep 04 19:22:10 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:10 devstack sudo[104668]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:10 devstack sudo[104667]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2f1120e9-a6b4-48e7-ad78-bf1034c79f92" returned: 0 in 0.314s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.941s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD" returned: 1 in 0.378s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] Creating offline snapshot 8fe4dbb9-81e4-4758-8ce5-ac9542405f05 of volume 036e2a92-d013-47ed-b047-9a9efeb9c509 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8822177-04fc-4e93-90a0-99dd2b7020d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1120e9-a6b4-48e7-ad78-bf1034c79f92', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648e3474-366d-4f75-a18f-7215eea4462e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff443156-8697-4c7e-a1df-dd1a5c42bb25]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:10 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Volume volume-2f1120e9-a6b4-48e7-ad78-bf1034c79f92 (2f1120e9-a6b4-48e7-ad78-bf1034c79f92): created successfully Sep 04 19:22:10 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (648e3474-366d-4f75-a18f-7215eea4462e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Flow 'volume_create_manager' (fed8511b-36ce-49f0-a38f-d8638b48587b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4" returned: 0 in 0.281s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Lock "cinder-quobyte-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4" released by "delete_volume" :: held 0.716s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dfac51f7-922b-4b21-97bc-b2d4c3eb35a4 tempest-CreateVolumesFromImageTest-775495669 None] Created volume successfully. Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Created reservations ['a95ee906-14b6-40ff-8b0d-909b5db0e227', '1d32ad19-9661-4a83-9261-702617581284', 'edca1c1b-3eae-4cb5-afe8-a30a077c31ae', '82164645-0261-40a9-8364-507fe9d6a40f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:10 devstack sudo[104681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509 Sep 04 19:22:10 devstack sudo[104681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:10 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:10 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:10 devstack sudo[104681]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509" returned: 0 in 0.394s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:10 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05 1G Sep 04 19:22:10 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:10 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:10 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Deleted volume successfully. Sep 04 19:22:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f6d465c1-30d4-4f1b-9432-65c6f1a9ed34 tempest-ProjectReaderTests-1611379847 None] Lock "cinder-8f95472c-1b8f-47b8-8c3c-24c9bf0507e4-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:11 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05 1G" returned: 0 in 0.429s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036e2a92-d013-47ed-b047-9a9efeb9c509 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:11 devstack sudo[104695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036e2a92-d013-47ed-b047-9a9efeb9c509 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05 Sep 04 19:22:11 devstack sudo[104695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Flow 'volume_create_manager' (5c6c3bc6-41bb-46bd-bc8e-d9e7d43738b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5a5866-0aea-40eb-8e30-73d6965f08fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5a5866-0aea-40eb-8e30-73d6965f08fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1264947280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1357c32b-7e32-40b3-9b03-7b7894591547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ceb5502ee74a2c839ba13e9529e50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:11Z,use_quota=True,user_id='207d38169f8a4c6cbd002d68a305acbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df126fdf-658f-4e1c-9d7a-1e3a2bb37ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df126fdf-658f-4e1c-9d7a-1e3a2bb37ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bfdd8d-29f5-41f0-802d-21ac11771eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9bfdd8d-29f5-41f0-802d-21ac11771eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1357c32b-7e32-40b3-9b03-7b7894591547', 'volume_name': 'volume-1357c32b-7e32-40b3-9b03-7b7894591547', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b67a916-e856-4f64-ba89-bdaf18d2041c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b67a916-e856-4f64-ba89-bdaf18d2041c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b0c84f-ccae-4707-add7-33cef92832a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:11 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Volume 1357c32b-7e32-40b3-9b03-7b7894591547: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1357c32b-7e32-40b3-9b03-7b7894591547', 'volume_size': 1} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:11 devstack sudo[104695]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-036e2a92-d013-47ed-b047-9a9efeb9c509 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:11 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05 is being set with open permissions: ugo+rw Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:11 devstack sudo[104700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05 Sep 04 19:22:11 devstack sudo[104700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "cinder-2f1120e9-a6b4-48e7-ad78-bf1034c79f92-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-2f1120e9-a6b4-48e7-ad78-bf1034c79f92-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "cinder-quobyte-2f1120e9-a6b4-48e7-ad78-bf1034c79f92" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-quobyte-2f1120e9-a6b4-48e7-ad78-bf1034c79f92" acquired by "delete_volume" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f738f7c-9f84-4b8d-b086-4e9d93a2d952]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2f1120e9-a6b4-48e7-ad78-bf1034c79f92 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:11 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2f1120e9-a6b4-48e7-ad78-bf1034c79f92 Sep 04 19:22:11 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:11 devstack sudo[104700]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05" returned: 0 in 0.266s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:11 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.info Sep 04 19:22:11 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:12 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2f1120e9-a6b4-48e7-ad78-bf1034c79f92" returned: 0 in 0.356s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2f1120e9-a6b4-48e7-ad78-bf1034c79f92 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:12 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2f1120e9-a6b4-48e7-ad78-bf1034c79f92 Sep 04 19:22:12 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:12 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.info" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:12 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.info is being set with open permissions: ugo+rw Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:12 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.info Sep 04 19:22:12 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:12 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2f1120e9-a6b4-48e7-ad78-bf1034c79f92" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-quobyte-2f1120e9-a6b4-48e7-ad78-bf1034c79f92" released by "delete_volume" :: held 0.653s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:12 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.info" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.982s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.970s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=595f9f18-29dc-40e3-9f68-8f2f5f4afc2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40ee4681c12e4bc49d51518878296166',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:08Z,use_quota=True,user_id='b2667b008076421ab9859187ef3053b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9d8a31cd-d390-43ef-b5f1-465f8bbb0299),volume_type_id=9d8a31cd-d390-43ef-b5f1-465f8bbb0299)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Creating volume 595f9f18-29dc-40e3-9f68-8f2f5f4afc2f {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:12 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:12 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f 1073741824 Sep 04 19:22:12 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:12 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-62f35bac-cb6f-4181-a6e0-0a9e22b4cbc1 tempest-CreateVolumesFromSnapshotTest-325442251 None] Create snapshot completed successfully Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Created reservations ['af368d6a-904f-478d-95a3-94b922753864', '3adc601c-9b3a-40a2-956e-c513ce40ea69', 'a515c32e-6c1a-46d0-a25a-4e9fe55dc6e1', '20b04bca-3e5c-4624-8a45-3abb03c54eda'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:12 devstack sudo[104720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:12 devstack sudo[104720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:12 devstack sudo[104720]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:12 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Deleted volume successfully. Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "cinder-7363a582-33de-45b0-9e9a-24d366683748-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dcdc6578-78f6-453b-8096-8d649a3da933 tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-2f1120e9-a6b4-48e7-ad78-bf1034c79f92-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-7363a582-33de-45b0-9e9a-24d366683748-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "cinder-quobyte-7363a582-33de-45b0-9e9a-24d366683748" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:12 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f 1073741824" returned: 0 in 0.488s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-quobyte-7363a582-33de-45b0-9e9a-24d366683748" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[915d2573-bd63-4b55-8bed-c79660b0ceef]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7363a582-33de-45b0-9e9a-24d366683748 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:12 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f Sep 04 19:22:12 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:13 devstack sudo[104727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7363a582-33de-45b0-9e9a-24d366683748 Sep 04 19:22:13 devstack sudo[104727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:13 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f" returned: 0 in 0.291s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.754s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1264947280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1357c32b-7e32-40b3-9b03-7b7894591547,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46ceb5502ee74a2c839ba13e9529e50f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:11Z,use_quota=True,user_id='207d38169f8a4c6cbd002d68a305acbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Creating volume 1357c32b-7e32-40b3-9b03-7b7894591547 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:13 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1357c32b-7e32-40b3-9b03-7b7894591547 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:13 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1357c32b-7e32-40b3-9b03-7b7894591547 1073741824 Sep 04 19:22:13 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Flow 'volume_create_manager' (068b09af-1868-4cba-9b4c-21650817a262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bcf2f2-b505-4d8a-af74-7c172ff1da10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Attempting download of 920d9a96-8753-42e9-9a87-4ac6d76aded2 ((None, [{'url': 'file:///opt/stack/data/glance/images/920d9a96-8753-42e9-9a87-4ac6d76aded2', 'metadata': {}}])) to volume 595f9f18-29dc-40e3-9f68-8f2f5f4afc2f. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9bcf2f2-b505-4d8a-af74-7c172ff1da10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-285977668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe92d32-0209-4e2e-9e2e-5e964a462313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0de716ff4344729617ade657ab2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:13Z,use_quota=True,user_id='09f4f217fea1418faa57179cd5b90e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f601cbe0-eb78-4de0-a396-becf7b522ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f601cbe0-eb78-4de0-a396-becf7b522ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d12cfc3-280b-4f0e-9b02-f0a61baa9726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d12cfc3-280b-4f0e-9b02-f0a61baa9726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fe92d32-0209-4e2e-9e2e-5e964a462313', 'volume_name': 'volume-3fe92d32-0209-4e2e-9e2e-5e964a462313', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4381e1de-6855-4b0c-b966-666f287551e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4381e1de-6855-4b0c-b966-666f287551e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dd8fb5-a51c-4674-81a3-0aca59ab2772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:13 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume 3fe92d32-0209-4e2e-9e2e-5e964a462313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fe92d32-0209-4e2e-9e2e-5e964a462313', 'volume_size': 1} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:13 devstack sudo[104727]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e351ed-c1f1-46a8-b616-baa0e1451b12]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_920d9a96-8753-42e9-9a87-4ac6d76aded2__nopv4ud {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7363a582-33de-45b0-9e9a-24d366683748" returned: 0 in 0.516s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7363a582-33de-45b0-9e9a-24d366683748 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:13 devstack sudo[104737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7363a582-33de-45b0-9e9a-24d366683748 Sep 04 19:22:13 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:13 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_920d9a96-8753-42e9-9a87-4ac6d76aded2__nopv4ud Sep 04 19:22:13 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Flow 'volume_create_manager' (ea0140ae-4a37-4aed-8a48-dd99c38dd201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91a602d-6761-4102-aa57-fd9e8f49a631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91a602d-6761-4102-aa57-fd9e8f49a631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-753170366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ec3aab-8daa-4edf-a161-682596ade27d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0de716ff4344729617ade657ab2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:14Z,use_quota=True,user_id='09f4f217fea1418faa57179cd5b90e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fbefe6-b3f0-4883-bc8f-4011c2bfb990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2fbefe6-b3f0-4883-bc8f-4011c2bfb990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833d8cf4-73b8-4630-a240-8527dd83a2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (833d8cf4-73b8-4630-a240-8527dd83a2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1ec3aab-8daa-4edf-a161-682596ade27d', 'volume_name': 'volume-b1ec3aab-8daa-4edf-a161-682596ade27d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143bf290-3d47-409b-b7ce-9e4741a493fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143bf290-3d47-409b-b7ce-9e4741a493fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b63cad-b41e-4fed-b790-bab6d49a0f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:13 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume b1ec3aab-8daa-4edf-a161-682596ade27d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1ec3aab-8daa-4edf-a161-682596ade27d', 'volume_size': 1} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:13 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-7363a582-33de-45b0-9e9a-24d366683748" returned: 0 in 0.402s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-quobyte-7363a582-33de-45b0-9e9a-24d366683748" released by "delete_volume" :: held 0.991s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:13 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1357c32b-7e32-40b3-9b03-7b7894591547 1073741824" returned: 0 in 0.682s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:13 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_920d9a96-8753-42e9-9a87-4ac6d76aded2__nopv4ud" returned: 0 in 0.508s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_920d9a96-8753-42e9-9a87-4ac6d76aded2__nopv4ud {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1357c32b-7e32-40b3-9b03-7b7894591547 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Created reservations ['6f7c80b0-3247-471a-bd66-6af5a5f9f103', 'a9bff75a-0562-40b4-b157-f66b5c515909', '6a961338-82c3-4e04-b4ff-961e3548b89b', '45239f38-1c6c-4483-b8f0-eecb8f1f8529'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:14 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1357c32b-7e32-40b3-9b03-7b7894591547 Sep 04 19:22:14 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:14 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_920d9a96-8753-42e9-9a87-4ac6d76aded2__nopv4ud Sep 04 19:22:14 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Flow 'volume_create_manager' (ab49ec6a-8b87-4244-965f-6bef018c3dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add687f9-703f-4000-aad9-c693c2141f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (add687f9-703f-4000-aad9-c693c2141f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1013138635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dae6fe7-c12a-4022-8d68-ebd81e9731fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0de716ff4344729617ade657ab2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:14Z,use_quota=True,user_id='09f4f217fea1418faa57179cd5b90e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701d7595-b7c3-4fe3-9767-6b87d84e2e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (701d7595-b7c3-4fe3-9767-6b87d84e2e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122e0304-c06c-4629-9988-04e3f51ac873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122e0304-c06c-4629-9988-04e3f51ac873) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dae6fe7-c12a-4022-8d68-ebd81e9731fd', 'volume_name': 'volume-8dae6fe7-c12a-4022-8d68-ebd81e9731fd', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8ad50f-8492-4299-85ca-b722a4f1d170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f8ad50f-8492-4299-85ca-b722a4f1d170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6561b597-5892-46a4-a34b-04d818a9cfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:14 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume 8dae6fe7-c12a-4022-8d68-ebd81e9731fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dae6fe7-c12a-4022-8d68-ebd81e9731fd', 'volume_size': 1} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:14 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:14 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:14 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1357c32b-7e32-40b3-9b03-7b7894591547" returned: 0 in 0.317s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-285977668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fe92d32-0209-4e2e-9e2e-5e964a462313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0de716ff4344729617ade657ab2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:13Z,use_quota=True,user_id='09f4f217fea1418faa57179cd5b90e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Creating volume 3fe92d32-0209-4e2e-9e2e-5e964a462313 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:14 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3fe92d32-0209-4e2e-9e2e-5e964a462313 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:14 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_920d9a96-8753-42e9-9a87-4ac6d76aded2__nopv4ud" returned: 1 in 0.415s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_920d9a96-8753-42e9-9a87-4ac6d76aded2__nopv4ud' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84b0c84f-ccae-4707-add7-33cef92832a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1357c32b-7e32-40b3-9b03-7b7894591547', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:14 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3fe92d32-0209-4e2e-9e2e-5e964a462313 1073741824 Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48e0c55-8535-459c-9b7f-b9f9fd83481c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:14 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8993e70f-41b2-40f7-bec5-c2fc0a5e55b1]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:14 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Volume volume-1357c32b-7e32-40b3-9b03-7b7894591547 (1357c32b-7e32-40b3-9b03-7b7894591547): created successfully Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48e0c55-8535-459c-9b7f-b9f9fd83481c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Flow 'volume_create_manager' (5c6c3bc6-41bb-46bd-bc8e-d9e7d43738b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ae0c996a-b1c3-41b6-a33f-2f735cabc473 tempest-ProjectReaderTests-1611379847 None] Created volume successfully. Sep 04 19:22:14 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD Sep 04 19:22:14 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:14 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.390s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Deleted volume successfully. Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Flow 'volume_create_manager' (a0035d3d-eb76-4d19-ba00-313f53135f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2571e39-d7b1-4bb0-b750-84f6808155c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-655eb89f-7b70-4917-a2c1-b9bb75db8529 tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-7363a582-33de-45b0-9e9a-24d366683748-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2571e39-d7b1-4bb0-b750-84f6808155c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1304195420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84109c0d-9025-48b8-b602-0102c0924d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0de716ff4344729617ade657ab2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:15Z,use_quota=True,user_id='09f4f217fea1418faa57179cd5b90e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2e2935-4cef-4abd-af64-62f39d2caebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2e2935-4cef-4abd-af64-62f39d2caebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7021123-9525-4cc3-a9a4-8e5ba4bc6431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7021123-9525-4cc3-a9a4-8e5ba4bc6431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84109c0d-9025-48b8-b602-0102c0924d3e', 'volume_name': 'volume-84109c0d-9025-48b8-b602-0102c0924d3e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63bded1c-896b-4dec-a909-1a040bc08a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:14 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63bded1c-896b-4dec-a909-1a040bc08a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2907d583-969b-4309-a833-c1d6ddcb9241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:14 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume 84109c0d-9025-48b8-b602-0102c0924d3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84109c0d-9025-48b8-b602-0102c0924d3e', 'volume_size': 1} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Acquiring lock "cinder-1357c32b-7e32-40b3-9b03-7b7894591547-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Lock "cinder-1357c32b-7e32-40b3-9b03-7b7894591547-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Acquiring lock "cinder-quobyte-1357c32b-7e32-40b3-9b03-7b7894591547" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Lock "cinder-quobyte-1357c32b-7e32-40b3-9b03-7b7894591547" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:15 devstack sudo[104765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD Sep 04 19:22:15 devstack sudo[104765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0874cd-3b6c-4b60-b888-d390f3bfed22]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1357c32b-7e32-40b3-9b03-7b7894591547 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "cinder-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:15 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3fe92d32-0209-4e2e-9e2e-5e964a462313 1073741824" returned: 0 in 0.890s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:15 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1357c32b-7e32-40b3-9b03-7b7894591547 Sep 04 19:22:15 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Flow 'volume_create_manager' (bfc91fd9-6e8a-4f07-86b3-2bc7bbffbf56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0960bfd2-d2d7-4373-975e-a8cd54c255be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "cinder-quobyte-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0960bfd2-d2d7-4373-975e-a8cd54c255be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-195797537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31db0345-dfe1-46c6-8036-ad1fd6ddff97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0de716ff4344729617ade657ab2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:15Z,use_quota=True,user_id='09f4f217fea1418faa57179cd5b90e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112c6e67-2bd2-4a91-b2d0-da569bf668fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (112c6e67-2bd2-4a91-b2d0-da569bf668fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4a5cd1-7cd4-43c5-898c-eb7793558e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d4a5cd1-7cd4-43c5-898c-eb7793558e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31db0345-dfe1-46c6-8036-ad1fd6ddff97', 'volume_name': 'volume-31db0345-dfe1-46c6-8036-ad1fd6ddff97', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0195c9-9aa1-4bce-b016-bcc2ee6d1ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d0195c9-9aa1-4bce-b016-bcc2ee6d1ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72eeadfb-3fe2-4854-b732-eed19d084173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume 31db0345-dfe1-46c6-8036-ad1fd6ddff97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31db0345-dfe1-46c6-8036-ad1fd6ddff97', 'volume_size': 1} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-quobyte-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3" acquired by "delete_volume" :: waited 0.065s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:15 devstack sudo[104765]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD" returned: 1 in 0.517s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3fe92d32-0209-4e2e-9e2e-5e964a462313 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] 920d9a96-8753-42e9-9a87-4ac6d76aded2 was raw, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:15 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3fe92d32-0209-4e2e-9e2e-5e964a462313 Sep 04 19:22:15 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6ea113-068f-4c6a-acd8-956778e7fc6d]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:15 devstack sudo[104775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f Sep 04 19:22:15 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:15 devstack sudo[104777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3 Sep 04 19:22:15 devstack sudo[104777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:15 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1357c32b-7e32-40b3-9b03-7b7894591547" returned: 0 in 0.508s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1357c32b-7e32-40b3-9b03-7b7894591547 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:15 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1357c32b-7e32-40b3-9b03-7b7894591547 Sep 04 19:22:15 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:15 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3fe92d32-0209-4e2e-9e2e-5e964a462313" returned: 0 in 0.289s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] <== create_volume: return (1338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.883s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-753170366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1ec3aab-8daa-4edf-a161-682596ade27d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0de716ff4344729617ade657ab2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:14Z,use_quota=True,user_id='09f4f217fea1418faa57179cd5b90e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Creating volume b1ec3aab-8daa-4edf-a161-682596ade27d {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:15 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ec3aab-8daa-4edf-a161-682596ade27d 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:15 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ec3aab-8daa-4edf-a161-682596ade27d 1073741824 Sep 04 19:22:15 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dd8fb5-a51c-4674-81a3-0aca59ab2772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fe92d32-0209-4e2e-9e2e-5e964a462313', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d182a446-41fa-411f-9351-0e2bb3b2b562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume volume-3fe92d32-0209-4e2e-9e2e-5e964a462313 (3fe92d32-0209-4e2e-9e2e-5e964a462313): created successfully Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d182a446-41fa-411f-9351-0e2bb3b2b562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Flow 'volume_create_manager' (068b09af-1868-4cba-9b4c-21650817a262) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-05364aaa-0bb4-4871-b96d-0cbba91db7ef tempest-CreateVolumesFromSnapshotTest-325442251 None] Created volume successfully. Sep 04 19:22:15 devstack sudo[104777]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3" returned: 0 in 0.457s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:15 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-1357c32b-7e32-40b3-9b03-7b7894591547" returned: 0 in 0.299s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Lock "cinder-quobyte-1357c32b-7e32-40b3-9b03-7b7894591547" released by "delete_volume" :: held 0.866s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:15 devstack sudo[104796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3 Sep 04 19:22:15 devstack sudo[104796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:15 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Created reservations ['7fb57021-5d63-46b9-be5a-490fc809ac90', '62e7e53c-5f2b-4dfd-b32e-b8bf44a61e4f', 'd2a2ec02-f768-4146-b6d7-b42314f93346', '66ce5269-215e-4b46-b1b5-3f2d1a2068c4'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:16 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f" returned: 0 in 0.603s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_920d9a96-8753-42e9-9a87-4ac6d76aded2_mu6krutqdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:22:16 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:16 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f 1G Sep 04 19:22:16 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:16 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:16 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:16 devstack sudo[104796]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3" returned: 0 in 0.323s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-quobyte-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3" released by "delete_volume" :: held 0.868s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:16 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ec3aab-8daa-4edf-a161-682596ade27d 1073741824" returned: 0 in 0.642s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Created reservations ['32b83420-b94a-4600-82ed-98348982c7da', '1ea94d16-7ccb-47cc-a39e-5115cf70be6a', '68cb33d2-f30a-4a1b-9d16-ade349a12601', 'b3e79bbe-964a-48ad-9dcf-cce8e46f51fd'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ec3aab-8daa-4edf-a161-682596ade27d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:16 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ec3aab-8daa-4edf-a161-682596ade27d Sep 04 19:22:16 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:16 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.425s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:16 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f 1G" returned: 0 in 0.506s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Downloaded image 920d9a96-8753-42e9-9a87-4ac6d76aded2 ((None, [{'url': 'file:///opt/stack/data/glance/images/920d9a96-8753-42e9-9a87-4ac6d76aded2', 'metadata': {}}])) to volume 595f9f18-29dc-40e3-9f68-8f2f5f4afc2f successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Temporary image 920d9a96-8753-42e9-9a87-4ac6d76aded2 for user b2667b008076421ab9859187ef3053b9 is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Marking volume 595f9f18-29dc-40e3-9f68-8f2f5f4afc2f as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 19:22:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Deleted volume successfully. Sep 04 19:22:16 devstack sudo[104814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:16 devstack sudo[104814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Copying metadata from image 920d9a96-8753-42e9-9a87-4ac6d76aded2 to 595f9f18-29dc-40e3-9f68-8f2f5f4afc2f. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Creating volume glance metadata for volume 595f9f18-29dc-40e3-9f68-8f2f5f4afc2f backed by image 920d9a96-8753-42e9-9a87-4ac6d76aded2 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '920d9a96-8753-42e9-9a87-4ac6d76aded2', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '8ee69f34cefb4b3653494260eba8bbf1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0de6b53d-015f-4a5f-8b7b-ff1cf029dcdc tempest-ProjectReaderTests-1611379847 None] Lock "cinder-1357c32b-7e32-40b3-9b03-7b7894591547-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6477a3a-8085-4850-a3e5-935f10a2c8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f', 'volume_size': 1, 'image_id': '920d9a96-8753-42e9-9a87-4ac6d76aded2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/920d9a96-8753-42e9-9a87-4ac6d76aded2', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '8ee69f34cefb4b3653494260eba8bbf1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '40ee4681c12e4bc49d51518878296166', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3403716a1e121a22e9b3c90cba6b56f94fbc06e91c1b65dd8b3c66299f755f4094c7d41c1bcfd9d14b1540b8734c080c5dc937d57a345d0008fc2f8e54b1bd14', 'id': '920d9a96-8753-42e9-9a87-4ac6d76aded2', 'created_at': datetime.datetime(2026, 9, 4, 17, 22, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 17, 22, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/920d9a96-8753-42e9-9a87-4ac6d76aded2/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a79fa1-303d-44ed-9a5d-6e7a2837edd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:16 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Volume volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f (595f9f18-29dc-40e3-9f68-8f2f5f4afc2f): created successfully Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56a79fa1-303d-44ed-9a5d-6e7a2837edd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Flow 'volume_create_manager' (9929afd9-62b8-4ce4-b393-08fc3804b75d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f9010fe4-0017-4163-b9dd-0746d2b90d06 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Created volume successfully. Sep 04 19:22:16 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ec3aab-8daa-4edf-a161-682596ade27d" returned: 0 in 0.329s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.521s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1013138635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dae6fe7-c12a-4022-8d68-ebd81e9731fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0de716ff4344729617ade657ab2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:14Z,use_quota=True,user_id='09f4f217fea1418faa57179cd5b90e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Creating volume 8dae6fe7-c12a-4022-8d68-ebd81e9731fd {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:16 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8dae6fe7-c12a-4022-8d68-ebd81e9731fd 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:16 devstack sudo[104818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8dae6fe7-c12a-4022-8d68-ebd81e9731fd 1073741824 Sep 04 19:22:16 devstack sudo[104818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3b63cad-b41e-4fed-b790-bab6d49a0f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1ec3aab-8daa-4edf-a161-682596ade27d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1ad08b-090e-4b6b-be9f-f3603ff55b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:16 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume volume-b1ec3aab-8daa-4edf-a161-682596ade27d (b1ec3aab-8daa-4edf-a161-682596ade27d): created successfully Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1ad08b-090e-4b6b-be9f-f3603ff55b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:16 devstack sudo[104814]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Flow 'volume_create_manager' (ea0140ae-4a37-4aed-8a48-dd99c38dd201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.326s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Deleted volume successfully. Sep 04 19:22:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a972b173-4dfc-4e4c-8368-282824283a66 tempest-CreateVolumesFromSnapshotTest-325442251 None] Created volume successfully. Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-7786774c-54e5-4161-bbf7-e90406a4bc91 tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-f6adcd4a-82ec-47e6-bbd4-376e295ef1e3-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Acquiring lock "cinder-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Lock "cinder-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Acquiring lock "cinder-quobyte-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Lock "cinder-quobyte-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[02371727-2d04-40b4-8462-79acb2eb7e1f]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:17 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f Sep 04 19:22:17 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:17 devstack sudo[104818]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8dae6fe7-c12a-4022-8d68-ebd81e9731fd 1073741824" returned: 0 in 0.525s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8dae6fe7-c12a-4022-8d68-ebd81e9731fd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:17 devstack sudo[104826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8dae6fe7-c12a-4022-8d68-ebd81e9731fd Sep 04 19:22:17 devstack sudo[104826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "cinder-b26c3a5e-56d3-4825-9f8f-936a4b82e500-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-b26c3a5e-56d3-4825-9f8f-936a4b82e500-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:17 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f" returned: 0 in 0.487s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:17 devstack sudo[104831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f Sep 04 19:22:17 devstack sudo[104831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "cinder-quobyte-b26c3a5e-56d3-4825-9f8f-936a4b82e500" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-quobyte-b26c3a5e-56d3-4825-9f8f-936a4b82e500" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73cd46f-93ca-4217-8d6f-d5c90b2e1336]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b26c3a5e-56d3-4825-9f8f-936a4b82e500 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:17 devstack sudo[104826]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8dae6fe7-c12a-4022-8d68-ebd81e9731fd" returned: 0 in 0.387s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.859s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1304195420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84109c0d-9025-48b8-b602-0102c0924d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0de716ff4344729617ade657ab2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:15Z,use_quota=True,user_id='09f4f217fea1418faa57179cd5b90e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Creating volume 84109c0d-9025-48b8-b602-0102c0924d3e {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:17 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84109c0d-9025-48b8-b602-0102c0924d3e 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:17 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84109c0d-9025-48b8-b602-0102c0924d3e 1073741824 Sep 04 19:22:17 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6561b597-5892-46a4-a34b-04d818a9cfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dae6fe7-c12a-4022-8d68-ebd81e9731fd', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c17738b-de6b-42c7-b5c2-4e117cb4d2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:17 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume volume-8dae6fe7-c12a-4022-8d68-ebd81e9731fd (8dae6fe7-c12a-4022-8d68-ebd81e9731fd): created successfully Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c17738b-de6b-42c7-b5c2-4e117cb4d2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Flow 'volume_create_manager' (ab49ec6a-8b87-4244-965f-6bef018c3dae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:17 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b26c3a5e-56d3-4825-9f8f-936a4b82e500 Sep 04 19:22:17 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:17 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-40c902c8-bdbc-43d3-b380-723f04976b2e tempest-CreateVolumesFromSnapshotTest-325442251 None] Created volume successfully. Sep 04 19:22:17 devstack sudo[104831]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f" returned: 0 in 0.318s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:17 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Lock "cinder-quobyte-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f" released by "delete_volume" :: held 0.851s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Created reservations ['7e9cb43a-3c13-4ff6-a328-6a70471e3246', '95e236d6-399c-4acc-8d74-004716355451', '0ca49e67-67ba-4db3-8ca1-2f70ac31f25f', 'd82ca1d6-3da5-4893-8600-7bcd1de3aaf4'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:18 devstack sudo[104845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:18 devstack sudo[104845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:18 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b26c3a5e-56d3-4825-9f8f-936a4b82e500" returned: 0 in 0.467s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b26c3a5e-56d3-4825-9f8f-936a4b82e500 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:18 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b26c3a5e-56d3-4825-9f8f-936a4b82e500 Sep 04 19:22:18 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:18 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84109c0d-9025-48b8-b602-0102c0924d3e 1073741824" returned: 0 in 0.660s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84109c0d-9025-48b8-b602-0102c0924d3e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:18 devstack sudo[104845]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.406s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:18 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:18 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84109c0d-9025-48b8-b602-0102c0924d3e Sep 04 19:22:18 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Deleted volume successfully. Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b26c3a5e-56d3-4825-9f8f-936a4b82e500" returned: 0 in 0.376s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-quobyte-b26c3a5e-56d3-4825-9f8f-936a4b82e500" released by "delete_volume" :: held 0.908s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-36577bee-d53b-4596-9a86-778dc23ac555 tempest-VolumeAndVolumeTypeFromImageTest-189906885 None] Lock "cinder-595f9f18-29dc-40e3-9f68-8f2f5f4afc2f-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Created reservations ['3e551b90-d7dc-48c5-92a3-d79034f1823b', '1d3c81bd-587a-4cca-8948-7538417b6e53', '6dfe6328-1d38-41d4-9fb8-5c699ca33e0b', '33994749-c730-461e-9bf1-24f1752246a3'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:18 devstack sudo[104854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:18 devstack sudo[104854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:18 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84109c0d-9025-48b8-b602-0102c0924d3e" returned: 0 in 0.402s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.514s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-195797537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31db0345-dfe1-46c6-8036-ad1fd6ddff97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea0de716ff4344729617ade657ab2297',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:15Z,use_quota=True,user_id='09f4f217fea1418faa57179cd5b90e3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Creating volume 31db0345-dfe1-46c6-8036-ad1fd6ddff97 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:18 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31db0345-dfe1-46c6-8036-ad1fd6ddff97 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2907d583-969b-4309-a833-c1d6ddcb9241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84109c0d-9025-48b8-b602-0102c0924d3e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:18 devstack sudo[104856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31db0345-dfe1-46c6-8036-ad1fd6ddff97 1073741824 Sep 04 19:22:18 devstack sudo[104856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7aaaad-acbe-44cb-801b-f743dd15da88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:18 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume volume-84109c0d-9025-48b8-b602-0102c0924d3e (84109c0d-9025-48b8-b602-0102c0924d3e): created successfully Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c7aaaad-acbe-44cb-801b-f743dd15da88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:18 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Flow 'volume_create_manager' (a0035d3d-eb76-4d19-ba00-313f53135f5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-afa10004-158a-43a5-8b55-c00780ab56d6 tempest-CreateVolumesFromSnapshotTest-325442251 None] Created volume successfully. Sep 04 19:22:19 devstack sudo[104854]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.350s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:19 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Deleted volume successfully. Sep 04 19:22:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-40297b32-987b-494a-89ee-693acfc3cb67 tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-b26c3a5e-56d3-4825-9f8f-936a4b82e500-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:19 devstack sudo[104856]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31db0345-dfe1-46c6-8036-ad1fd6ddff97 1073741824" returned: 0 in 0.579s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31db0345-dfe1-46c6-8036-ad1fd6ddff97 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:19 devstack sudo[104863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31db0345-dfe1-46c6-8036-ad1fd6ddff97 Sep 04 19:22:19 devstack sudo[104863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:19 devstack sudo[104863]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31db0345-dfe1-46c6-8036-ad1fd6ddff97" returned: 0 in 0.278s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72eeadfb-3fe2-4854-b732-eed19d084173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31db0345-dfe1-46c6-8036-ad1fd6ddff97', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a06151-5f7c-4a86-8236-bebdb91f2e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:19 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Volume volume-31db0345-dfe1-46c6-8036-ad1fd6ddff97 (31db0345-dfe1-46c6-8036-ad1fd6ddff97): created successfully Sep 04 19:22:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a06151-5f7c-4a86-8236-bebdb91f2e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Flow 'volume_create_manager' (bfc91fd9-6e8a-4f07-86b3-2bc7bbffbf56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c7dec665-0c4e-4348-915a-f76d8ef78c42 tempest-CreateVolumesFromSnapshotTest-325442251 None] Created volume successfully. Sep 04 19:22:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "cinder-d0dd0210-57d6-449f-9fc3-573f492782af-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-d0dd0210-57d6-449f-9fc3-573f492782af-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "cinder-quobyte-d0dd0210-57d6-449f-9fc3-573f492782af" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-quobyte-d0dd0210-57d6-449f-9fc3-573f492782af" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:20 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15fdea7-7689-46d1-8b34-7f9fc812869c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d0dd0210-57d6-449f-9fc3-573f492782af {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:20 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d0dd0210-57d6-449f-9fc3-573f492782af Sep 04 19:22:20 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:20 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d0dd0210-57d6-449f-9fc3-573f492782af" returned: 0 in 0.424s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d0dd0210-57d6-449f-9fc3-573f492782af {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:20 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d0dd0210-57d6-449f-9fc3-573f492782af Sep 04 19:22:20 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:20 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d0dd0210-57d6-449f-9fc3-573f492782af" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:20 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-quobyte-d0dd0210-57d6-449f-9fc3-573f492782af" released by "delete_volume" :: held 0.774s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:20 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Created reservations ['27660b33-ad2a-45ef-bbb2-1d730b50bb09', '8b13ea03-762e-4350-87f8-672b537e73b1', '82713ed9-da3c-48e1-80db-c11037460286', '38d24bf5-2a01-400b-8dfa-b9ed8a4c790e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:20 devstack sudo[104875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:20 devstack sudo[104875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "cinder-31db0345-dfe1-46c6-8036-ad1fd6ddff97-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-31db0345-dfe1-46c6-8036-ad1fd6ddff97-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "cinder-quobyte-31db0345-dfe1-46c6-8036-ad1fd6ddff97" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-quobyte-31db0345-dfe1-46c6-8036-ad1fd6ddff97" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2481e8-5425-48a1-a26e-4d980510635b]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31db0345-dfe1-46c6-8036-ad1fd6ddff97 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:21 devstack sudo[104875]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.392s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:21 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:21 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Deleted volume successfully. Sep 04 19:22:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-780265c6-5d57-4167-8ffc-73739ad5327d tempest-CreateVolumesFromImageTest-775495669 None] Lock "cinder-d0dd0210-57d6-449f-9fc3-573f492782af-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:21 devstack sudo[104878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31db0345-dfe1-46c6-8036-ad1fd6ddff97 Sep 04 19:22:21 devstack sudo[104878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:21 devstack sudo[104878]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31db0345-dfe1-46c6-8036-ad1fd6ddff97" returned: 0 in 0.554s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31db0345-dfe1-46c6-8036-ad1fd6ddff97 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:21 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31db0345-dfe1-46c6-8036-ad1fd6ddff97 Sep 04 19:22:21 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:22 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-31db0345-dfe1-46c6-8036-ad1fd6ddff97" returned: 0 in 0.351s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-quobyte-31db0345-dfe1-46c6-8036-ad1fd6ddff97" released by "delete_volume" :: held 0.999s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:22 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Created reservations ['1914fc84-abb8-49ed-9f6f-6124365dc7ff', '0718eb92-7aa5-4b26-a0db-53471c66ec2f', '97c1d67a-3f71-4e5a-ad1b-23a2bc410360', 'e62e0454-b73b-4249-b798-b8dbab5706fc'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:22 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:22 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:22 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.361s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:22 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:22 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Deleted volume successfully. Sep 04 19:22:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0efc609f-e772-41c9-9524-8533ef2fa089 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-31db0345-dfe1-46c6-8036-ad1fd6ddff97-delete_volume" released by "delete_volume" :: held 1.819s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "cinder-84109c0d-9025-48b8-b602-0102c0924d3e-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-84109c0d-9025-48b8-b602-0102c0924d3e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "cinder-quobyte-84109c0d-9025-48b8-b602-0102c0924d3e" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-quobyte-84109c0d-9025-48b8-b602-0102c0924d3e" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:23 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[74642be4-3719-4f9d-b47f-0759437eb919]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84109c0d-9025-48b8-b602-0102c0924d3e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:23 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84109c0d-9025-48b8-b602-0102c0924d3e Sep 04 19:22:23 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:23 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84109c0d-9025-48b8-b602-0102c0924d3e" returned: 0 in 0.393s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84109c0d-9025-48b8-b602-0102c0924d3e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:23 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84109c0d-9025-48b8-b602-0102c0924d3e Sep 04 19:22:23 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:24 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84109c0d-9025-48b8-b602-0102c0924d3e" returned: 0 in 0.285s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-quobyte-84109c0d-9025-48b8-b602-0102c0924d3e" released by "delete_volume" :: held 0.741s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Created reservations ['f3ba3564-c2bb-4ac9-84e0-33cb0f02b78d', 'ae40b1a9-e7fc-4c4e-a3fb-531bc92036b8', 'd03c9171-66a5-44cc-810c-b4018f59e331', '9bb58fd5-5d22-411b-82e4-f7ca28b94b20'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:24 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:24 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "cinder-8dae6fe7-c12a-4022-8d68-ebd81e9731fd-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-8dae6fe7-c12a-4022-8d68-ebd81e9731fd-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:24 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.371s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Deleted volume successfully. Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "cinder-quobyte-8dae6fe7-c12a-4022-8d68-ebd81e9731fd" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-975f477c-7143-4a36-b592-56da59ccd6c4 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-84109c0d-9025-48b8-b602-0102c0924d3e-delete_volume" released by "delete_volume" :: held 1.432s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Flow 'volume_create_manager' (71f84f45-bf56-4582-8062-b2385825eaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0420f8-7646-42b1-bd2c-a5f07f4f90b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c0420f8-7646-42b1-bd2c-a5f07f4f90b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-396720050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a92869-d45b-41f1-a147-d4a55a7a1e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb05299bdd2463c8df14432712cf12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:25Z,use_quota=True,user_id='a9d7509cf90c4f24be02202e79272093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36a355a-e59d-4c04-8bf2-8e1b2f0a54b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c36a355a-e59d-4c04-8bf2-8e1b2f0a54b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fbc1ce-10e7-46a1-868d-bdaa178f95f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66fbc1ce-10e7-46a1-868d-bdaa178f95f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90a92869-d45b-41f1-a147-d4a55a7a1e1d', 'volume_name': 'volume-90a92869-d45b-41f1-a147-d4a55a7a1e1d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4da363-ad51-4699-b54e-bf62ebc4d64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e4da363-ad51-4699-b54e-bf62ebc4d64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65314441-63eb-4ebd-b57f-0b570e27fe5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume 90a92869-d45b-41f1-a147-d4a55a7a1e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90a92869-d45b-41f1-a147-d4a55a7a1e1d', 'volume_size': 1} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-396720050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a92869-d45b-41f1-a147-d4a55a7a1e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb05299bdd2463c8df14432712cf12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:25Z,use_quota=True,user_id='a9d7509cf90c4f24be02202e79272093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Creating volume 90a92869-d45b-41f1-a147-d4a55a7a1e1d {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:24 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-90a92869-d45b-41f1-a147-d4a55a7a1e1d 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-quobyte-8dae6fe7-c12a-4022-8d68-ebd81e9731fd" acquired by "delete_volume" :: waited 0.147s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:25 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-90a92869-d45b-41f1-a147-d4a55a7a1e1d 1073741824 Sep 04 19:22:25 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[139a4647-059c-451b-afd6-88ee6e8a9e74]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8dae6fe7-c12a-4022-8d68-ebd81e9731fd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:25 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8dae6fe7-c12a-4022-8d68-ebd81e9731fd Sep 04 19:22:25 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:25 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-90a92869-d45b-41f1-a147-d4a55a7a1e1d 1073741824" returned: 0 in 0.555s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:25 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8dae6fe7-c12a-4022-8d68-ebd81e9731fd" returned: 0 in 0.512s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8dae6fe7-c12a-4022-8d68-ebd81e9731fd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:25 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8dae6fe7-c12a-4022-8d68-ebd81e9731fd Sep 04 19:22:25 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-90a92869-d45b-41f1-a147-d4a55a7a1e1d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:25 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-90a92869-d45b-41f1-a147-d4a55a7a1e1d Sep 04 19:22:25 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Flow 'volume_create_manager' (eb2fb521-e77b-4751-8c91-14c0b692ffa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bf38f2-1028-42df-aa20-c3ce83b7a2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57bf38f2-1028-42df-aa20-c3ce83b7a2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94560779-3a7e-4214-8175-69b5482f5bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34ad164885b4030a0ea979d1a740adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:26Z,use_quota=True,user_id='7f83e9f220ab4746b07a7e3a0fbe5b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac86f0db-371a-4770-b2fc-2827932f4de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac86f0db-371a-4770-b2fc-2827932f4de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e390d3-8cf4-4e42-8cae-631b34306eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e390d3-8cf4-4e42-8cae-631b34306eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94560779-3a7e-4214-8175-69b5482f5bcc', 'volume_name': 'volume-94560779-3a7e-4214-8175-69b5482f5bcc', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d445e1cd-a0f8-44d6-862f-cd3341f33e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d445e1cd-a0f8-44d6-862f-cd3341f33e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a46040-e4ee-4a9d-b528-7c8df0182fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:25 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Volume 94560779-3a7e-4214-8175-69b5482f5bcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94560779-3a7e-4214-8175-69b5482f5bcc', 'volume_size': 1} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:25 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8dae6fe7-c12a-4022-8d68-ebd81e9731fd" returned: 0 in 0.358s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:25 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-90a92869-d45b-41f1-a147-d4a55a7a1e1d" returned: 0 in 0.314s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-quobyte-8dae6fe7-c12a-4022-8d68-ebd81e9731fd" released by "delete_volume" :: held 0.931s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.142s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94560779-3a7e-4214-8175-69b5482f5bcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34ad164885b4030a0ea979d1a740adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:26Z,use_quota=True,user_id='7f83e9f220ab4746b07a7e3a0fbe5b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Creating volume 94560779-3a7e-4214-8175-69b5482f5bcc {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:25 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94560779-3a7e-4214-8175-69b5482f5bcc 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:25 devstack sudo[104918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94560779-3a7e-4214-8175-69b5482f5bcc 1073741824 Sep 04 19:22:25 devstack sudo[104918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65314441-63eb-4ebd-b57f-0b570e27fe5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90a92869-d45b-41f1-a147-d4a55a7a1e1d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:25 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb4b008-7307-4037-8ad8-b27d809e7d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:26 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume volume-90a92869-d45b-41f1-a147-d4a55a7a1e1d (90a92869-d45b-41f1-a147-d4a55a7a1e1d): created successfully Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cb4b008-7307-4037-8ad8-b27d809e7d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Flow 'volume_create_manager' (71f84f45-bf56-4582-8062-b2385825eaaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d9dfe364-be60-4f39-ba65-b9fcfeccc395 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Created volume successfully. Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Created reservations ['7d7bad03-e82e-4509-a17c-76c4e509e68b', 'b742f6f6-4cbf-4f97-94cf-a2cd2d3bc82e', 'aaca05f7-4116-4942-ba9a-b3e19d6d4dd8', '1d9e4004-8ab0-46cd-a691-fbc6ae855a85'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:26 devstack sudo[104920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:26 devstack sudo[104920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:26 devstack sudo[104920]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Deleted volume successfully. Sep 04 19:22:26 devstack sudo[104918]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94560779-3a7e-4214-8175-69b5482f5bcc 1073741824" returned: 0 in 0.445s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d56d86b6-8306-4f0c-951f-c641d8f1f07f tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-8dae6fe7-c12a-4022-8d68-ebd81e9731fd-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94560779-3a7e-4214-8175-69b5482f5bcc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:26 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94560779-3a7e-4214-8175-69b5482f5bcc Sep 04 19:22:26 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:26 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94560779-3a7e-4214-8175-69b5482f5bcc" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7a46040-e4ee-4a9d-b528-7c8df0182fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94560779-3a7e-4214-8175-69b5482f5bcc', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ae8a31-6cea-47e8-bf2b-e147d0e72748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:26 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Volume volume-94560779-3a7e-4214-8175-69b5482f5bcc (94560779-3a7e-4214-8175-69b5482f5bcc): created successfully Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50ae8a31-6cea-47e8-bf2b-e147d0e72748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Flow 'volume_create_manager' (eb2fb521-e77b-4751-8c91-14c0b692ffa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-7c4a181f-9642-4029-9283-a83b700153b5 tempest-CinderUnicodeTest-1986314301 None] Created volume successfully. Sep 04 19:22:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "cinder-b1ec3aab-8daa-4edf-a161-682596ade27d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-b1ec3aab-8daa-4edf-a161-682596ade27d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "cinder-quobyte-b1ec3aab-8daa-4edf-a161-682596ade27d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-quobyte-b1ec3aab-8daa-4edf-a161-682596ade27d" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0c6ff1-47ff-47fe-b1f4-3d702c4c1f9e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ec3aab-8daa-4edf-a161-682596ade27d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:27 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ec3aab-8daa-4edf-a161-682596ade27d Sep 04 19:22:27 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Flow 'volume_create_manager' (fbe5d2a0-526e-415a-821c-07de69091dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83c8f15-75d7-493d-bde3-22a95c59a7da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f83c8f15-75d7-493d-bde3-22a95c59a7da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1022240104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8279aae0-1322-4abe-99a0-8e4aa52e07f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb05299bdd2463c8df14432712cf12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:27Z,use_quota=True,user_id='a9d7509cf90c4f24be02202e79272093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80ce884-5c13-473c-a4e6-2e41820a73ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80ce884-5c13-473c-a4e6-2e41820a73ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7f1f44-8e3e-4f4f-9134-5510d89d0554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7f1f44-8e3e-4f4f-9134-5510d89d0554) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8279aae0-1322-4abe-99a0-8e4aa52e07f9', 'volume_name': 'volume-8279aae0-1322-4abe-99a0-8e4aa52e07f9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099b0245-9b7b-49bf-8747-c9b6c282c6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (099b0245-9b7b-49bf-8747-c9b6c282c6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf42593f-27cd-4d88-a85e-96367dffda11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:27 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume 8279aae0-1322-4abe-99a0-8e4aa52e07f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8279aae0-1322-4abe-99a0-8e4aa52e07f9', 'volume_size': 1} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1022240104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8279aae0-1322-4abe-99a0-8e4aa52e07f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb05299bdd2463c8df14432712cf12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:27Z,use_quota=True,user_id='a9d7509cf90c4f24be02202e79272093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Creating volume 8279aae0-1322-4abe-99a0-8e4aa52e07f9 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:27 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279aae0-1322-4abe-99a0-8e4aa52e07f9 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:27 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279aae0-1322-4abe-99a0-8e4aa52e07f9 1073741824 Sep 04 19:22:27 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:27 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ec3aab-8daa-4edf-a161-682596ade27d" returned: 0 in 0.458s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ec3aab-8daa-4edf-a161-682596ade27d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:27 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ec3aab-8daa-4edf-a161-682596ade27d Sep 04 19:22:27 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Flow 'volume_create_manager' (bd93064c-1904-4a81-bcf3-ccb12eab20e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55321807-ed49-4eef-808f-c59c66d6bdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55321807-ed49-4eef-808f-c59c66d6bdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-914602216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c385fed-452e-4ab5-93ff-20eb0b02a83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb05299bdd2463c8df14432712cf12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:28Z,use_quota=True,user_id='a9d7509cf90c4f24be02202e79272093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d3952b-b3a0-41cd-97d9-14aac579d1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85d3952b-b3a0-41cd-97d9-14aac579d1ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f12bf4-f925-43ae-afe0-23febd2b258b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6f12bf4-f925-43ae-afe0-23febd2b258b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c385fed-452e-4ab5-93ff-20eb0b02a83e', 'volume_name': 'volume-9c385fed-452e-4ab5-93ff-20eb0b02a83e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813b16e6-f8a9-4d12-9546-8a95a75640fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813b16e6-f8a9-4d12-9546-8a95a75640fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1104782f-0a0c-497a-a6ea-51c8e9ec81ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:28 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume 9c385fed-452e-4ab5-93ff-20eb0b02a83e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c385fed-452e-4ab5-93ff-20eb0b02a83e', 'volume_size': 1} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:28 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Flow 'volume_create_manager' (215de43e-0f80-41c5-adf7-c205e9d63161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12da24fb-45b2-4e01-8795-8f0ebac68c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b1ec3aab-8daa-4edf-a161-682596ade27d" returned: 0 in 0.636s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12da24fb-45b2-4e01-8795-8f0ebac68c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-214582650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733401d1-f4be-4908-b3d0-a53b22950441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20dc08b187b748febc2f29e04bc912bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:28Z,use_quota=True,user_id='f93ca64eaca44f519420e0bde5528d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:28 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ff4001-79aa-4fdb-a855-2797c92ae350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ff4001-79aa-4fdb-a855-2797c92ae350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80178c95-14b3-4dea-b314-10d711790dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80178c95-14b3-4dea-b314-10d711790dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '733401d1-f4be-4908-b3d0-a53b22950441', 'volume_name': 'volume-733401d1-f4be-4908-b3d0-a53b22950441', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70278143-b69d-49ea-9e5a-cb57009d0e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70278143-b69d-49ea-9e5a-cb57009d0e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a05d04b-737c-431b-a63e-31b225045fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:28 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Volume 733401d1-f4be-4908-b3d0-a53b22950441: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-733401d1-f4be-4908-b3d0-a53b22950441', 'volume_size': 1} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279aae0-1322-4abe-99a0-8e4aa52e07f9 1073741824" returned: 0 in 0.772s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-quobyte-b1ec3aab-8daa-4edf-a161-682596ade27d" released by "delete_volume" :: held 1.213s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279aae0-1322-4abe-99a0-8e4aa52e07f9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:28 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279aae0-1322-4abe-99a0-8e4aa52e07f9 Sep 04 19:22:28 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Flow 'volume_create_manager' (fe11a720-133b-4019-877d-c36226e1a60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c6f3f2-aa5d-4f71-9d6e-2c8e53f03def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99c6f3f2-aa5d-4f71-9d6e-2c8e53f03def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1512296104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7b4f50-f92a-4924-bf9f-d781f482ca7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb05299bdd2463c8df14432712cf12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:28Z,use_quota=True,user_id='a9d7509cf90c4f24be02202e79272093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a101d5c6-0fc9-4aa1-bbe7-4418a2f26004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a101d5c6-0fc9-4aa1-bbe7-4418a2f26004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0fc73f-5b4f-482c-a021-75595cd6b4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec0fc73f-5b4f-482c-a021-75595cd6b4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c7b4f50-f92a-4924-bf9f-d781f482ca7d', 'volume_name': 'volume-2c7b4f50-f92a-4924-bf9f-d781f482ca7d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9c67cd-53f8-48ab-b246-deda576b331f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba9c67cd-53f8-48ab-b246-deda576b331f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fbfc69c-a9a0-4067-9902-b1b7dbe85a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:28 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume 2c7b4f50-f92a-4924-bf9f-d781f482ca7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c7b4f50-f92a-4924-bf9f-d781f482ca7d', 'volume_size': 1} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Created reservations ['65e46e21-f292-4c1f-baf7-337731124349', 'c150d040-aa17-4aef-a6e8-977305b420e6', '12ec453e-2ce0-41ee-8f88-5847527109fe', '5c3f30d9-5476-4c7a-8c74-5654e1d5383e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:28 devstack sudo[104945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:28 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:28 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279aae0-1322-4abe-99a0-8e4aa52e07f9" returned: 0 in 0.474s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.332s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-914602216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c385fed-452e-4ab5-93ff-20eb0b02a83e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb05299bdd2463c8df14432712cf12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:28Z,use_quota=True,user_id='a9d7509cf90c4f24be02202e79272093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Creating volume 9c385fed-452e-4ab5-93ff-20eb0b02a83e {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:28 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9c385fed-452e-4ab5-93ff-20eb0b02a83e 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf42593f-27cd-4d88-a85e-96367dffda11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8279aae0-1322-4abe-99a0-8e4aa52e07f9', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c230c4e5-00c1-4185-84ac-3f6e784d8cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:28 devstack sudo[104949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9c385fed-452e-4ab5-93ff-20eb0b02a83e 1073741824 Sep 04 19:22:28 devstack sudo[104949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:28 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume volume-8279aae0-1322-4abe-99a0-8e4aa52e07f9 (8279aae0-1322-4abe-99a0-8e4aa52e07f9): created successfully Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c230c4e5-00c1-4185-84ac-3f6e784d8cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Flow 'volume_create_manager' (fbe5d2a0-526e-415a-821c-07de69091dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-aa2e6d82-8076-4bfe-998b-177a8918dafc tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Created volume successfully. Sep 04 19:22:29 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.337s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Deleted volume successfully. Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-de0590fd-b51b-4415-a21e-4e8cf116dce9 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-b1ec3aab-8daa-4edf-a161-682596ade27d-delete_volume" released by "delete_volume" :: held 2.054s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Flow 'volume_create_manager' (c786c48e-9a24-41d6-857d-ad006d34139d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ad4fe5-95c7-4664-aaa4-5018f62a375b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ad4fe5-95c7-4664-aaa4-5018f62a375b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1640863522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3096eb-ee07-402b-bd3f-8398fbd0896d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb05299bdd2463c8df14432712cf12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:29Z,use_quota=True,user_id='a9d7509cf90c4f24be02202e79272093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73924691-8ba8-43e1-bc5b-c76c310cbed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73924691-8ba8-43e1-bc5b-c76c310cbed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddaa9fd5-312e-4635-96a1-4b7a9ff649cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddaa9fd5-312e-4635-96a1-4b7a9ff649cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c3096eb-ee07-402b-bd3f-8398fbd0896d', 'volume_name': 'volume-6c3096eb-ee07-402b-bd3f-8398fbd0896d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f327e1-ea8c-4d85-9185-4da394813d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3f327e1-ea8c-4d85-9185-4da394813d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a159c31d-c83e-48e4-933c-6038ab067d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:29 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume 6c3096eb-ee07-402b-bd3f-8398fbd0896d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c3096eb-ee07-402b-bd3f-8398fbd0896d', 'volume_size': 1} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "cinder-3fe92d32-0209-4e2e-9e2e-5e964a462313-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-3fe92d32-0209-4e2e-9e2e-5e964a462313-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "cinder-quobyte-3fe92d32-0209-4e2e-9e2e-5e964a462313" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Flow 'volume_create_manager' (dfcaeff9-a4b7-4a7c-810a-7fe83a76280d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d911eb-2d43-46a9-ac9a-5297050e5b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-quobyte-3fe92d32-0209-4e2e-9e2e-5e964a462313" acquired by "delete_volume" :: waited 0.057s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ea0c1c-d9f1-4f24-a695-79fd5bd8b9ae]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3fe92d32-0209-4e2e-9e2e-5e964a462313 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d911eb-2d43-46a9-ac9a-5297050e5b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-299657926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3218dc-275f-42fc-9a01-79f4c16651ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34ad164885b4030a0ea979d1a740adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:29Z,use_quota=True,user_id='7f83e9f220ab4746b07a7e3a0fbe5b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d29ea5-1754-4036-838a-ee282c498f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4d29ea5-1754-4036-838a-ee282c498f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:29 devstack sudo[104949]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e4fa0e-76e5-4183-9844-a0f34a7e9e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9e4fa0e-76e5-4183-9844-a0f34a7e9e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3218dc-275f-42fc-9a01-79f4c16651ab', 'volume_name': 'volume-0d3218dc-275f-42fc-9a01-79f4c16651ab', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47df11bd-9102-4c09-b733-c720770446d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47df11bd-9102-4c09-b733-c720770446d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a159ced4-d47b-49e1-9ff5-f6e3bc6c81d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:29 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Volume 0d3218dc-275f-42fc-9a01-79f4c16651ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3218dc-275f-42fc-9a01-79f4c16651ab', 'volume_size': 1} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9c385fed-452e-4ab5-93ff-20eb0b02a83e 1073741824" returned: 0 in 0.707s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Flow 'volume_create_manager' (6141c104-ec57-4ee2-91d9-5df06b19f4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80601a0-6039-4ff8-b340-459bf4bb38dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:29 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3fe92d32-0209-4e2e-9e2e-5e964a462313 Sep 04 19:22:29 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80601a0-6039-4ff8-b340-459bf4bb38dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1843591867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a8ce40-b656-43f5-a55d-74d7991cd665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb05299bdd2463c8df14432712cf12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:29Z,use_quota=True,user_id='a9d7509cf90c4f24be02202e79272093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73521a6-c049-49e3-8b6c-b41feb03f582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d73521a6-c049-49e3-8b6c-b41feb03f582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea09f00c-0b20-4bda-abf3-d24ff7c311bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea09f00c-0b20-4bda-abf3-d24ff7c311bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85a8ce40-b656-43f5-a55d-74d7991cd665', 'volume_name': 'volume-85a8ce40-b656-43f5-a55d-74d7991cd665', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47ba4aa-e01a-45f1-ba1a-c45c0485cfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a47ba4aa-e01a-45f1-ba1a-c45c0485cfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06877d66-b8d2-4e56-8065-16d8b68687a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:29 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume 85a8ce40-b656-43f5-a55d-74d7991cd665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85a8ce40-b656-43f5-a55d-74d7991cd665', 'volume_size': 1} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9c385fed-452e-4ab5-93ff-20eb0b02a83e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:29 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9c385fed-452e-4ab5-93ff-20eb0b02a83e Sep 04 19:22:29 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:29 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3fe92d32-0209-4e2e-9e2e-5e964a462313" returned: 0 in 0.364s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3fe92d32-0209-4e2e-9e2e-5e964a462313 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:29 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3fe92d32-0209-4e2e-9e2e-5e964a462313 Sep 04 19:22:29 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:29 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9c385fed-452e-4ab5-93ff-20eb0b02a83e" returned: 0 in 0.271s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.669s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-214582650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=733401d1-f4be-4908-b3d0-a53b22950441,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20dc08b187b748febc2f29e04bc912bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:28Z,use_quota=True,user_id='f93ca64eaca44f519420e0bde5528d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Creating volume 733401d1-f4be-4908-b3d0-a53b22950441 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:29 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-733401d1-f4be-4908-b3d0-a53b22950441 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:30 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-733401d1-f4be-4908-b3d0-a53b22950441 1073741824 Sep 04 19:22:30 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1104782f-0a0c-497a-a6ea-51c8e9ec81ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c385fed-452e-4ab5-93ff-20eb0b02a83e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefed94e-09d1-40b5-8ad9-31b20a919076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:30 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume volume-9c385fed-452e-4ab5-93ff-20eb0b02a83e (9c385fed-452e-4ab5-93ff-20eb0b02a83e): created successfully Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cefed94e-09d1-40b5-8ad9-31b20a919076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Flow 'volume_create_manager' (bd93064c-1904-4a81-bcf3-ccb12eab20e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-20b644b4-e940-4dfc-99b7-798a5f5f21f2 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Created volume successfully. Sep 04 19:22:30 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3fe92d32-0209-4e2e-9e2e-5e964a462313" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-quobyte-3fe92d32-0209-4e2e-9e2e-5e964a462313" released by "delete_volume" :: held 0.659s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Created reservations ['f1f505ae-3c9a-483c-8471-d7ca75cf9d7d', 'b3bad14a-6443-4283-8488-8c4deb57d37f', '3e9547de-99ca-4684-aaab-847ef50fcb6e', '7b23f475-40b5-4834-82ee-889a77072f94'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:30 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:30 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:30 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-733401d1-f4be-4908-b3d0-a53b22950441 1073741824" returned: 0 in 0.503s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-733401d1-f4be-4908-b3d0-a53b22950441 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "cinder-8fe4dbb9-81e4-4758-8ce5-ac9542405f05-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:30 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:30 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-733401d1-f4be-4908-b3d0-a53b22950441 Sep 04 19:22:30 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.284s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-8fe4dbb9-81e4-4758-8ce5-ac9542405f05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "cinder-quobyte-036e2a92-d013-47ed-b047-9a9efeb9c509" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Deleted volume successfully. Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-quobyte-036e2a92-d013-47ed-b047-9a9efeb9c509" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "cinder-quobyte-8fe4dbb9-81e4-4758-8ce5-ac9542405f05" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e35c6f21-0f62-45cf-aee2-0a2b73dddf7e tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-3fe92d32-0209-4e2e-9e2e-5e964a462313-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-quobyte-8fe4dbb9-81e4-4758-8ce5-ac9542405f05" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Deleting offline snapshot 8fe4dbb9-81e4-4758-8ce5-ac9542405f05 of volume 036e2a92-d013-47ed-b047-9a9efeb9c509 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] snapshot_file for this snap is: volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[858ee0df-79d7-4f92-bf06-308e4b36cca5]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:30 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05 Sep 04 19:22:30 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:30 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-733401d1-f4be-4908-b3d0-a53b22950441" returned: 0 in 0.268s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.231s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1512296104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c7b4f50-f92a-4924-bf9f-d781f482ca7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb05299bdd2463c8df14432712cf12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:28Z,use_quota=True,user_id='a9d7509cf90c4f24be02202e79272093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Creating volume 2c7b4f50-f92a-4924-bf9f-d781f482ca7d {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:30 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2c7b4f50-f92a-4924-bf9f-d781f482ca7d 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a05d04b-737c-431b-a63e-31b225045fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-733401d1-f4be-4908-b3d0-a53b22950441', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:30 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2c7b4f50-f92a-4924-bf9f-d781f482ca7d 1073741824 Sep 04 19:22:30 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481303f3-dae9-4185-86e6-841b16a98160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:30 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Volume volume-733401d1-f4be-4908-b3d0-a53b22950441 (733401d1-f4be-4908-b3d0-a53b22950441): created successfully Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (481303f3-dae9-4185-86e6-841b16a98160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:30 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Flow 'volume_create_manager' (215de43e-0f80-41c5-adf7-c205e9d63161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:30 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-14fcaa40-2344-4bea-bf72-01c35ee397a7 tempest-ProjectReaderTests-173221154 None] Created volume successfully. Sep 04 19:22:31 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05" returned: 0 in 0.429s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-036e2a92-d013-47ed-b047-9a9efeb9c509(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97f637d-a5ae-4317-bfa4-15515d0ba657]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:31 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509 Sep 04 19:22:31 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:31 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2c7b4f50-f92a-4924-bf9f-d781f482ca7d 1073741824" returned: 0 in 0.419s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2c7b4f50-f92a-4924-bf9f-d781f482ca7d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:31 devstack sudo[104992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2c7b4f50-f92a-4924-bf9f-d781f482ca7d Sep 04 19:22:31 devstack sudo[104992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:31 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509" returned: 0 in 0.402s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:31 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05 Sep 04 19:22:31 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:31 devstack sudo[104992]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2c7b4f50-f92a-4924-bf9f-d781f482ca7d" returned: 0 in 0.298s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.312s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1640863522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c3096eb-ee07-402b-bd3f-8398fbd0896d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb05299bdd2463c8df14432712cf12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:29Z,use_quota=True,user_id='a9d7509cf90c4f24be02202e79272093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Creating volume 6c3096eb-ee07-402b-bd3f-8398fbd0896d {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:31 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6c3096eb-ee07-402b-bd3f-8398fbd0896d 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Acquiring lock "cinder-733401d1-f4be-4908-b3d0-a53b22950441-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fbfc69c-a9a0-4067-9902-b1b7dbe85a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c7b4f50-f92a-4924-bf9f-d781f482ca7d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddb5d08-7e1c-49d3-ae42-99f0efab7e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:31 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6c3096eb-ee07-402b-bd3f-8398fbd0896d 1073741824 Sep 04 19:22:31 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Lock "cinder-733401d1-f4be-4908-b3d0-a53b22950441-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:31 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume volume-2c7b4f50-f92a-4924-bf9f-d781f482ca7d (2c7b4f50-f92a-4924-bf9f-d781f482ca7d): created successfully Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ddb5d08-7e1c-49d3-ae42-99f0efab7e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Flow 'volume_create_manager' (fe11a720-133b-4019-877d-c36226e1a60b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-874255b3-1f8a-460a-92b5-043b41900296 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Created volume successfully. Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Acquiring lock "cinder-quobyte-733401d1-f4be-4908-b3d0-a53b22950441" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Lock "cinder-quobyte-733401d1-f4be-4908-b3d0-a53b22950441" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a0b83a-21f9-46a6-a6b9-cb210bd85703]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-733401d1-f4be-4908-b3d0-a53b22950441 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:31 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-733401d1-f4be-4908-b3d0-a53b22950441 Sep 04 19:22:31 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:31 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05" returned: 0 in 0.437s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:31 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05 Sep 04 19:22:31 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:32 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6c3096eb-ee07-402b-bd3f-8398fbd0896d 1073741824" returned: 0 in 0.488s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6c3096eb-ee07-402b-bd3f-8398fbd0896d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:32 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6c3096eb-ee07-402b-bd3f-8398fbd0896d Sep 04 19:22:32 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:32 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-733401d1-f4be-4908-b3d0-a53b22950441" returned: 0 in 0.428s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-733401d1-f4be-4908-b3d0-a53b22950441 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:32 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509.8fe4dbb9-81e4-4758-8ce5-ac9542405f05" returned: 0 in 0.278s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:32 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-733401d1-f4be-4908-b3d0-a53b22950441 Sep 04 19:22:32 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-quobyte-8fe4dbb9-81e4-4758-8ce5-ac9542405f05" released by "_delete_snapshot" :: held 1.666s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-quobyte-036e2a92-d013-47ed-b047-9a9efeb9c509" released by "delete_snapshot" :: held 1.701s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Created reservations ['12d5c863-d851-40fa-9550-5b413b40b06d', '24a98cdd-8808-4741-b762-4024001ad317', 'e6d3e3de-2d42-4b46-b628-88353b610264', 'cb361963-bd80-4107-81d9-25b2cd527b57'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Delete snapshot completed successfully. Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2a846cfc-bace-483f-ac38-14445d1b9d2b tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-8fe4dbb9-81e4-4758-8ce5-ac9542405f05-delete_snapshot" released by "delete_snapshot" :: held 1.867s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:32 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6c3096eb-ee07-402b-bd3f-8398fbd0896d" returned: 0 in 0.310s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.874s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:29Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-299657926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3218dc-275f-42fc-9a01-79f4c16651ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34ad164885b4030a0ea979d1a740adf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:29Z,use_quota=True,user_id='7f83e9f220ab4746b07a7e3a0fbe5b2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Creating volume 0d3218dc-275f-42fc-9a01-79f4c16651ab {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:32 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a159c31d-c83e-48e4-933c-6038ab067d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c3096eb-ee07-402b-bd3f-8398fbd0896d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:32 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab 1073741824 Sep 04 19:22:32 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:32 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b01d4d-19e7-4ac1-833b-3041ec40f321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-733401d1-f4be-4908-b3d0-a53b22950441" returned: 0 in 0.299s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Lock "cinder-quobyte-733401d1-f4be-4908-b3d0-a53b22950441" released by "delete_volume" :: held 0.769s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:32 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume volume-6c3096eb-ee07-402b-bd3f-8398fbd0896d (6c3096eb-ee07-402b-bd3f-8398fbd0896d): created successfully Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6b01d4d-19e7-4ac1-833b-3041ec40f321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Flow 'volume_create_manager' (c786c48e-9a24-41d6-857d-ad006d34139d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a18138c2-0f56-40b9-ade5-38b56d08e439 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Created volume successfully. Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Created reservations ['eb37c370-10b1-40d2-8a9b-47b716da5a0e', '9d8a5614-2a50-4e7a-b56b-996008f026c5', '83cfe74c-a3e3-4996-b5a4-37998aa4b1f8', '055e3433-c008-4a71-9356-903aece9ce74'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:32 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:32 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "cinder-036e2a92-d013-47ed-b047-9a9efeb9c509-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-036e2a92-d013-47ed-b047-9a9efeb9c509-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "cinder-quobyte-036e2a92-d013-47ed-b047-9a9efeb9c509" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-quobyte-036e2a92-d013-47ed-b047-9a9efeb9c509" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca94973-0952-403a-ab13-5af1f2f2cd8c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:32 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.299s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:32 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:33 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Deleted volume successfully. Sep 04 19:22:33 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab 1073741824" returned: 0 in 0.565s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:33 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509 Sep 04 19:22:33 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a529db8d-79d5-4dad-8953-934655964c5c tempest-ProjectReaderTests-173221154 None] Lock "cinder-733401d1-f4be-4908-b3d0-a53b22950441-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:33 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab Sep 04 19:22:33 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:33 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509" returned: 0 in 0.470s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:33 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab" returned: 0 in 0.302s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.713s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1843591867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85a8ce40-b656-43f5-a55d-74d7991cd665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfb05299bdd2463c8df14432712cf12f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:29Z,use_quota=True,user_id='a9d7509cf90c4f24be02202e79272093',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Creating volume 85a8ce40-b656-43f5-a55d-74d7991cd665 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:33 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:33 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509 Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-85a8ce40-b656-43f5-a55d-74d7991cd665 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:33 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a159ced4-d47b-49e1-9ff5-f6e3bc6c81d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3218dc-275f-42fc-9a01-79f4c16651ab', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:33 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-85a8ce40-b656-43f5-a55d-74d7991cd665 1073741824 Sep 04 19:22:33 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef85fbe4-ad98-4c45-9451-1c24fd3893fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:33 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Volume volume-0d3218dc-275f-42fc-9a01-79f4c16651ab (0d3218dc-275f-42fc-9a01-79f4c16651ab): created successfully Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef85fbe4-ad98-4c45-9451-1c24fd3893fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Flow 'volume_create_manager' (dfcaeff9-a4b7-4a7c-810a-7fe83a76280d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Flow 'volume_create_manager' (22dfa24c-c3b9-428c-8aa1-314afc00cf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ecff21-0d07-414e-a3fa-74eacb9e6e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:33 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1379ef2f-9597-4559-9966-9209a89c193b tempest-CinderUnicodeTest-1986314301 None] Created volume successfully. Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ecff21-0d07-414e-a3fa-74eacb9e6e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-449286621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9dfa898-8bd4-4746-b4b0-585589c14af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20dc08b187b748febc2f29e04bc912bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:33Z,use_quota=True,user_id='f93ca64eaca44f519420e0bde5528d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6332b1e9-38ab-4a25-b758-ad0cab50c207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6332b1e9-38ab-4a25-b758-ad0cab50c207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5f08ba5-6295-4199-96db-3cad6127e252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5f08ba5-6295-4199-96db-3cad6127e252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9dfa898-8bd4-4746-b4b0-585589c14af8', 'volume_name': 'volume-b9dfa898-8bd4-4746-b4b0-585589c14af8', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47966c46-4057-443a-baa2-581786df365f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47966c46-4057-443a-baa2-581786df365f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4f6119-bd75-496f-bc66-41c7238224a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:33 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Volume b9dfa898-8bd4-4746-b4b0-585589c14af8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9dfa898-8bd4-4746-b4b0-585589c14af8', 'volume_size': 1} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:33 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-036e2a92-d013-47ed-b047-9a9efeb9c509" returned: 0 in 0.313s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-quobyte-036e2a92-d013-47ed-b047-9a9efeb9c509" released by "delete_volume" :: held 0.856s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Created reservations ['87ce2b1e-9c0c-4c62-ac6c-54eaa97ce77a', '16e1dcb3-eb1c-4d36-b138-21ab40966534', '94e07c8a-ec06-4048-b777-611bac3df528', '47d3770b-6a5c-48b7-9f18-9070bd0ae6e4'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:33 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:33 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:34 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-85a8ce40-b656-43f5-a55d-74d7991cd665 1073741824" returned: 0 in 0.610s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-85a8ce40-b656-43f5-a55d-74d7991cd665 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:34 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-85a8ce40-b656-43f5-a55d-74d7991cd665 Sep 04 19:22:34 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:34 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.271s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Deleted volume successfully. Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-84009e10-9851-42d2-84d9-f4149d5f3d40 tempest-CreateVolumesFromSnapshotTest-325442251 None] Lock "cinder-036e2a92-d013-47ed-b047-9a9efeb9c509-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:34 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-85a8ce40-b656-43f5-a55d-74d7991cd665" returned: 0 in 0.301s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.713s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-449286621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9dfa898-8bd4-4746-b4b0-585589c14af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20dc08b187b748febc2f29e04bc912bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:33Z,use_quota=True,user_id='f93ca64eaca44f519420e0bde5528d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Creating volume b9dfa898-8bd4-4746-b4b0-585589c14af8 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:34 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b9dfa898-8bd4-4746-b4b0-585589c14af8 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:34 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b9dfa898-8bd4-4746-b4b0-585589c14af8 1073741824 Sep 04 19:22:34 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06877d66-b8d2-4e56-8065-16d8b68687a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85a8ce40-b656-43f5-a55d-74d7991cd665', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1835afe-86b4-4b17-98a7-b12036567dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:34 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Volume volume-85a8ce40-b656-43f5-a55d-74d7991cd665 (85a8ce40-b656-43f5-a55d-74d7991cd665): created successfully Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1835afe-86b4-4b17-98a7-b12036567dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Flow 'volume_create_manager' (6141c104-ec57-4ee2-91d9-5df06b19f4a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ec2f62f2-527b-4a87-a7c6-caffa886bd6b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Created volume successfully. Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:34 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b9dfa898-8bd4-4746-b4b0-585589c14af8 1073741824" returned: 0 in 0.475s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b9dfa898-8bd4-4746-b4b0-585589c14af8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:34 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b9dfa898-8bd4-4746-b4b0-585589c14af8 Sep 04 19:22:34 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "cinder-85a8ce40-b656-43f5-a55d-74d7991cd665-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-85a8ce40-b656-43f5-a55d-74d7991cd665-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:35 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b9dfa898-8bd4-4746-b4b0-585589c14af8" returned: 0 in 0.292s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.632s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "cinder-quobyte-85a8ce40-b656-43f5-a55d-74d7991cd665" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] Creating offline snapshot 836e3dcd-57db-4c65-9abd-590a04f0e3b2 of volume 0d3218dc-275f-42fc-9a01-79f4c16651ab {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd4f6119-bd75-496f-bc66-41c7238224a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9dfa898-8bd4-4746-b4b0-585589c14af8', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9533eb-2c6c-447c-ad57-6648c9f995ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-quobyte-85a8ce40-b656-43f5-a55d-74d7991cd665" acquired by "delete_volume" :: waited 0.040s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce876ae8-2758-432f-9575-55c9ab8c0a93]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf115a4-a6a0-476c-984b-79cdea8b08ef]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-85a8ce40-b656-43f5-a55d-74d7991cd665 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:35 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Volume volume-b9dfa898-8bd4-4746-b4b0-585589c14af8 (b9dfa898-8bd4-4746-b4b0-585589c14af8): created successfully Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9533eb-2c6c-447c-ad57-6648c9f995ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Flow 'volume_create_manager' (22dfa24c-c3b9-428c-8aa1-314afc00cf43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dc10167e-9b5e-40ab-af53-c4613c7d74ac tempest-ProjectReaderTests-173221154 None] Created volume successfully. Sep 04 19:22:35 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab Sep 04 19:22:35 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:35 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-85a8ce40-b656-43f5-a55d-74d7991cd665 Sep 04 19:22:35 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Acquiring lock "cinder-b9dfa898-8bd4-4746-b4b0-585589c14af8-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Lock "cinder-b9dfa898-8bd4-4746-b4b0-585589c14af8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:35 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-85a8ce40-b656-43f5-a55d-74d7991cd665" returned: 0 in 0.433s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-85a8ce40-b656-43f5-a55d-74d7991cd665 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:35 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab" returned: 0 in 0.497s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:35 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-85a8ce40-b656-43f5-a55d-74d7991cd665 Sep 04 19:22:35 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Acquiring lock "cinder-quobyte-b9dfa898-8bd4-4746-b4b0-585589c14af8" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:35 devstack sudo[105112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2 1G Sep 04 19:22:35 devstack sudo[105112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Lock "cinder-quobyte-b9dfa898-8bd4-4746-b4b0-585589c14af8" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[163c218e-0611-449a-a762-3a80aafd60b2]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b9dfa898-8bd4-4746-b4b0-585589c14af8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:35 devstack sudo[105115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b9dfa898-8bd4-4746-b4b0-585589c14af8 Sep 04 19:22:35 devstack sudo[105115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:36 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-85a8ce40-b656-43f5-a55d-74d7991cd665" returned: 0 in 0.344s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-quobyte-85a8ce40-b656-43f5-a55d-74d7991cd665" released by "delete_volume" :: held 0.832s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Created reservations ['cb4f55d4-bb82-446e-94bd-d36325b2b497', '9f32f65d-fc26-40b2-bbc0-71b7aaa1b9ae', '9de336b8-c919-4af5-9f3b-e26f7ea25a68', 'e39ae094-3756-4017-810f-ed995e7b2ce2'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:36 devstack sudo[105112]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2 1G" returned: 0 in 0.496s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3218dc-275f-42fc-9a01-79f4c16651ab -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:36 devstack sudo[105115]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b9dfa898-8bd4-4746-b4b0-585589c14af8" returned: 0 in 0.443s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:36 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:36 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b9dfa898-8bd4-4746-b4b0-585589c14af8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:36 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3218dc-275f-42fc-9a01-79f4c16651ab -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2 Sep 04 19:22:36 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:36 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b9dfa898-8bd4-4746-b4b0-585589c14af8 Sep 04 19:22:36 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "cinder-6c3096eb-ee07-402b-bd3f-8398fbd0896d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-6c3096eb-ee07-402b-bd3f-8398fbd0896d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "cinder-quobyte-6c3096eb-ee07-402b-bd3f-8398fbd0896d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-quobyte-6c3096eb-ee07-402b-bd3f-8398fbd0896d" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c08a44d-e47f-445b-9c39-417d7913a75e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6c3096eb-ee07-402b-bd3f-8398fbd0896d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:36 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.364s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:36 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-b9dfa898-8bd4-4746-b4b0-585589c14af8" returned: 0 in 0.341s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Deleted volume successfully. Sep 04 19:22:36 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6c3096eb-ee07-402b-bd3f-8398fbd0896d Sep 04 19:22:36 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Lock "cinder-quobyte-b9dfa898-8bd4-4746-b4b0-585589c14af8" released by "delete_volume" :: held 0.874s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a45f67cc-0621-4f7d-9499-d7f1ad508743 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-85a8ce40-b656-43f5-a55d-74d7991cd665-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Created reservations ['ef0ee4f1-0665-4ade-bfde-14cff7ac7816', 'f1303e99-5404-4424-b0d7-05fbf888c77a', '3ef12d37-d674-4be6-94dc-fe7c7ee47975', '66abfb23-edc4-4b83-88e0-c234400427f2'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:36 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3218dc-275f-42fc-9a01-79f4c16651ab -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2" returned: 0 in 0.525s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:36 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2 is being set with open permissions: ugo+rw Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:36 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2 Sep 04 19:22:36 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:36 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:36 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:36 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6c3096eb-ee07-402b-bd3f-8398fbd0896d" returned: 0 in 0.507s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6c3096eb-ee07-402b-bd3f-8398fbd0896d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:37 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6c3096eb-ee07-402b-bd3f-8398fbd0896d Sep 04 19:22:37 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:37 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2" returned: 0 in 0.324s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:37 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.384s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:37 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.info Sep 04 19:22:37 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Deleted volume successfully. Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-81ba4bcf-149f-4cbb-b445-324af595e77a tempest-ProjectReaderTests-173221154 None] Lock "cinder-b9dfa898-8bd4-4746-b4b0-585589c14af8-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:37 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-6c3096eb-ee07-402b-bd3f-8398fbd0896d" returned: 0 in 0.373s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-quobyte-6c3096eb-ee07-402b-bd3f-8398fbd0896d" released by "delete_volume" :: held 0.943s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Created reservations ['0667e17b-55f3-4b6e-a47c-3ce1bece838d', 'd668fc69-54e8-46d5-b454-298ce2a678d4', 'd51d387f-3590-49a6-8ae5-82edd5ad5a0b', '8b2d6712-ebac-40b8-8b64-c8c7c68209ab'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Flow 'volume_create_manager' (27d35e6c-50d1-4d1e-8477-9e83307c8739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cfc970-0d0c-45a7-a1f2-3443867cbe12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cfc970-0d0c-45a7-a1f2-3443867cbe12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2108164259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ea3899-f975-43bb-b9e1-013cd87f9413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20dc08b187b748febc2f29e04bc912bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:37Z,use_quota=True,user_id='f93ca64eaca44f519420e0bde5528d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3565e6cd-67ab-4a7c-8140-8b6feb9a57fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3565e6cd-67ab-4a7c-8140-8b6feb9a57fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6283948-abe7-4179-a502-ba16773e2094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6283948-abe7-4179-a502-ba16773e2094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8ea3899-f975-43bb-b9e1-013cd87f9413', 'volume_name': 'volume-d8ea3899-f975-43bb-b9e1-013cd87f9413', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1365f838-2c75-4445-a867-803caca9340c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1365f838-2c75-4445-a867-803caca9340c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d6efd5-3462-427a-9015-0f7d1577619d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:37 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Volume d8ea3899-f975-43bb-b9e1-013cd87f9413: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8ea3899-f975-43bb-b9e1-013cd87f9413', 'volume_size': 1} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:37 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.info" returned: 0 in 0.548s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:37 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.info is being set with open permissions: ugo+rw Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:37 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.info Sep 04 19:22:37 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Flow 'volume_create_manager' (ccb853d6-730d-4b3f-ac88-96b5ee2b6157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5a4a97-0be8-4f81-98fe-410c4a6f2352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:37 devstack sudo[105157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:37 devstack sudo[105157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5a4a97-0be8-4f81-98fe-410c4a6f2352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-890773442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a33a3f-ae42-48c2-bfec-f607e9aa2d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4855e44aa5da4953ac73443ec7b6e26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:38Z,use_quota=True,user_id='98288eee9b024ee6a4b590cd13d73035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1495dfaf-3789-47e2-bbcf-23976fa071fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1495dfaf-3789-47e2-bbcf-23976fa071fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a60284-2b4d-42ab-8beb-58fcac4f5b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a60284-2b4d-42ab-8beb-58fcac4f5b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03a33a3f-ae42-48c2-bfec-f607e9aa2d66', 'volume_name': 'volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127110d8-4de6-47cb-a067-d6120ad0c292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (127110d8-4de6-47cb-a067-d6120ad0c292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b07e68a-c5b7-45f8-97af-2517adb946de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:37 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Volume 03a33a3f-ae42-48c2-bfec-f607e9aa2d66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66', 'volume_size': 1} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:37 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.info" returned: 0 in 0.254s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.816s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.319s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2108164259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ea3899-f975-43bb-b9e1-013cd87f9413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20dc08b187b748febc2f29e04bc912bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:37Z,use_quota=True,user_id='f93ca64eaca44f519420e0bde5528d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Creating volume d8ea3899-f975-43bb-b9e1-013cd87f9413 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:38 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ea3899-f975-43bb-b9e1-013cd87f9413 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:38 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ea3899-f975-43bb-b9e1-013cd87f9413 1073741824 Sep 04 19:22:38 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5c51b7b8-67b9-422f-b037-70190eef094f tempest-CinderUnicodeTest-1986314301 None] Create snapshot completed successfully Sep 04 19:22:38 devstack sudo[105157]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.277s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Deleted volume successfully. Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a4dc09ac-05fe-4312-b684-136d297b8929 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-6c3096eb-ee07-402b-bd3f-8398fbd0896d-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:38 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ea3899-f975-43bb-b9e1-013cd87f9413 1073741824" returned: 0 in 0.454s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ea3899-f975-43bb-b9e1-013cd87f9413 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:38 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ea3899-f975-43bb-b9e1-013cd87f9413 Sep 04 19:22:38 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "cinder-2c7b4f50-f92a-4924-bf9f-d781f482ca7d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-2c7b4f50-f92a-4924-bf9f-d781f482ca7d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:38 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "cinder-quobyte-2c7b4f50-f92a-4924-bf9f-d781f482ca7d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ea3899-f975-43bb-b9e1-013cd87f9413" returned: 0 in 0.260s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-890773442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03a33a3f-ae42-48c2-bfec-f607e9aa2d66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4855e44aa5da4953ac73443ec7b6e26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:38Z,use_quota=True,user_id='98288eee9b024ee6a4b590cd13d73035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Creating volume 03a33a3f-ae42-48c2-bfec-f607e9aa2d66 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:38 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:38 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 1073741824 Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81d6efd5-3462-427a-9015-0f7d1577619d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ea3899-f975-43bb-b9e1-013cd87f9413', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:38 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226d8144-641e-4fb7-99b3-fd5fc64be4cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-quobyte-2c7b4f50-f92a-4924-bf9f-d781f482ca7d" acquired by "delete_volume" :: waited 0.053s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Acquiring lock "cinder-836e3dcd-57db-4c65-9abd-590a04f0e3b2-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9c301e-8313-4c68-9b28-68999ff1b4a5]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2c7b4f50-f92a-4924-bf9f-d781f482ca7d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:38 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Volume volume-d8ea3899-f975-43bb-b9e1-013cd87f9413 (d8ea3899-f975-43bb-b9e1-013cd87f9413): created successfully Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (226d8144-641e-4fb7-99b3-fd5fc64be4cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Flow 'volume_create_manager' (27d35e6c-50d1-4d1e-8477-9e83307c8739) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Lock "cinder-836e3dcd-57db-4c65-9abd-590a04f0e3b2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Acquiring lock "cinder-quobyte-0d3218dc-275f-42fc-9a01-79f4c16651ab" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-036694cb-b4f4-40b8-a28c-601b799ab5ea tempest-ProjectReaderTests-173221154 None] Created volume successfully. Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Lock "cinder-quobyte-0d3218dc-275f-42fc-9a01-79f4c16651ab" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Acquiring lock "cinder-quobyte-836e3dcd-57db-4c65-9abd-590a04f0e3b2" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Lock "cinder-quobyte-836e3dcd-57db-4c65-9abd-590a04f0e3b2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Deleting offline snapshot 836e3dcd-57db-4c65-9abd-590a04f0e3b2 of volume 0d3218dc-275f-42fc-9a01-79f4c16651ab {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:22:38 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2c7b4f50-f92a-4924-bf9f-d781f482ca7d Sep 04 19:22:38 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] snapshot_file for this snap is: volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba040f30-6c95-4dab-9018-55a467ab48cd]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:39 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2 Sep 04 19:22:39 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:39 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 1073741824" returned: 0 in 0.414s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:39 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2c7b4f50-f92a-4924-bf9f-d781f482ca7d" returned: 0 in 0.396s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2c7b4f50-f92a-4924-bf9f-d781f482ca7d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:39 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 Sep 04 19:22:39 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:39 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2c7b4f50-f92a-4924-bf9f-d781f482ca7d Sep 04 19:22:39 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:39 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2" returned: 0 in 0.376s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d3218dc-275f-42fc-9a01-79f4c16651ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4d60d2-f698-42d7-bac2-d55b8e1fadea]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:39 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66" returned: 0 in 0.264s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] <== create_volume: return (724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:39 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab Sep 04 19:22:39 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b07e68a-c5b7-45f8-97af-2517adb946de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25abb52-7232-48c7-b406-7feb9e4f61a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:39 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Volume volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 (03a33a3f-ae42-48c2-bfec-f607e9aa2d66): created successfully Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f25abb52-7232-48c7-b406-7feb9e4f61a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Flow 'volume_create_manager' (ccb853d6-730d-4b3f-ac88-96b5ee2b6157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:39 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-2c7b4f50-f92a-4924-bf9f-d781f482ca7d" returned: 0 in 0.313s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-quobyte-2c7b4f50-f92a-4924-bf9f-d781f482ca7d" released by "delete_volume" :: held 0.776s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-91f8cfc0-6f2c-4659-bbba-3ab2f5e65db2 tempest-VolumeDependencyTests-1741002841 None] Created volume successfully. Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Created reservations ['9d05081f-6157-4141-aea7-0a6270912e06', 'fe35c699-472d-4835-b330-b44c9c44cdf7', '8ebe6266-7d6c-4082-82a1-745dbef7b9b7', '719d2faf-2f07-4942-b695-5e57cec04258'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Acquiring lock "cinder-d8ea3899-f975-43bb-b9e1-013cd87f9413-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Lock "cinder-d8ea3899-f975-43bb-b9e1-013cd87f9413-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Acquiring lock "cinder-quobyte-d8ea3899-f975-43bb-b9e1-013cd87f9413" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:39 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab" returned: 0 in 0.426s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:39 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:39 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Lock "cinder-quobyte-d8ea3899-f975-43bb-b9e1-013cd87f9413" acquired by "delete_volume" :: waited 0.090s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:39 devstack sudo[105200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2 Sep 04 19:22:39 devstack sudo[105200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "cinder-9c385fed-452e-4ab5-93ff-20eb0b02a83e-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ed30f5-7975-46e1-ab05-d1a20e991edf]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-9c385fed-452e-4ab5-93ff-20eb0b02a83e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ea3899-f975-43bb-b9e1-013cd87f9413 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "cinder-quobyte-9c385fed-452e-4ab5-93ff-20eb0b02a83e" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-quobyte-9c385fed-452e-4ab5-93ff-20eb0b02a83e" acquired by "delete_volume" :: waited 0.049s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:40 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.338s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:40 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Deleted volume successfully. Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc705274-a0db-4acb-9894-f9dcba9cab48]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9c385fed-452e-4ab5-93ff-20eb0b02a83e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:40 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ea3899-f975-43bb-b9e1-013cd87f9413 Sep 04 19:22:40 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] Creating offline snapshot 3bbd2f8a-c68a-4793-bc30-89ba6269b931 of volume 03a33a3f-ae42-48c2-bfec-f607e9aa2d66 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14f01ead-2f2d-433d-bf3e-d6b3eb02b6ae tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-2c7b4f50-f92a-4924-bf9f-d781f482ca7d-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c9640d-4efd-4a85-83e3-3ee9aaa2aa1b]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:40 devstack sudo[105206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9c385fed-452e-4ab5-93ff-20eb0b02a83e Sep 04 19:22:40 devstack sudo[105206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:40 devstack sudo[105200]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2" returned: 0 in 0.515s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:40 devstack sudo[105210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 Sep 04 19:22:40 devstack sudo[105210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:40 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2 Sep 04 19:22:40 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:40 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ea3899-f975-43bb-b9e1-013cd87f9413" returned: 0 in 0.547s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ea3899-f975-43bb-b9e1-013cd87f9413 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:40 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ea3899-f975-43bb-b9e1-013cd87f9413 Sep 04 19:22:40 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:40 devstack sudo[105206]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9c385fed-452e-4ab5-93ff-20eb0b02a83e" returned: 0 in 0.466s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9c385fed-452e-4ab5-93ff-20eb0b02a83e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:40 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab.836e3dcd-57db-4c65-9abd-590a04f0e3b2" returned: 0 in 0.289s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:40 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9c385fed-452e-4ab5-93ff-20eb0b02a83e Sep 04 19:22:40 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:40 devstack sudo[105210]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66" returned: 0 in 0.458s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Lock "cinder-quobyte-836e3dcd-57db-4c65-9abd-590a04f0e3b2" released by "_delete_snapshot" :: held 1.744s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Lock "cinder-quobyte-0d3218dc-275f-42fc-9a01-79f4c16651ab" released by "delete_snapshot" :: held 1.773s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:40 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 1G Sep 04 19:22:40 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:40 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-d8ea3899-f975-43bb-b9e1-013cd87f9413" returned: 0 in 0.279s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Lock "cinder-quobyte-d8ea3899-f975-43bb-b9e1-013cd87f9413" released by "delete_volume" :: held 0.941s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Created reservations ['6a1fcde9-1027-456d-93e3-7f48d1e37c9b', '29a024c5-5152-41c4-af7d-1a8338c30041', '2b60b4f5-b7cb-427a-8fff-439527e44a8c', 'cfc4e50c-9dc7-4345-abae-e315e7083f33'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Created reservations ['274d98df-d917-4630-a2e0-12ab33541cbd', 'bda1a488-876b-4a19-adcb-00d4fcbefea9', '49319848-6543-41fe-b848-ec81ff0cee31', 'a53edc87-24c1-4a09-9940-477edc4f672f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:40 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9c385fed-452e-4ab5-93ff-20eb0b02a83e" returned: 0 in 0.304s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:40 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Delete snapshot completed successfully. Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-quobyte-9c385fed-452e-4ab5-93ff-20eb0b02a83e" released by "delete_volume" :: held 0.836s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-aeda2226-6a0f-47b4-ae51-fd0f206720f2 tempest-CinderUnicodeTest-1986314301 None] Lock "cinder-836e3dcd-57db-4c65-9abd-590a04f0e3b2-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:40 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:40 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Created reservations ['c79a7c77-b7e9-474e-b7bd-e78e75317d97', '12d536ad-2401-4f84-8d27-1fa214c545f9', '2487c782-68de-4bf7-ae62-b422d2d555a7', '36f44ef9-2bdb-4b85-b902-4f8f49d59c65'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:41 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:41 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Acquiring lock "cinder-0d3218dc-275f-42fc-9a01-79f4c16651ab-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:41 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 1G" returned: 0 in 0.566s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Lock "cinder-0d3218dc-275f-42fc-9a01-79f4c16651ab-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:41 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:41 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 Sep 04 19:22:41 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.339s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Deleted volume successfully. Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Acquiring lock "cinder-quobyte-0d3218dc-275f-42fc-9a01-79f4c16651ab" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Lock "cinder-quobyte-0d3218dc-275f-42fc-9a01-79f4c16651ab" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1699e819-1d25-4564-843c-587ce2e33280 tempest-ProjectReaderTests-173221154 None] Lock "cinder-d8ea3899-f975-43bb-b9e1-013cd87f9413-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9866b90-e70f-4159-87d8-2637d23bd09a]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:41 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.308s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Deleted volume successfully. Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-32d390e3-cd66-4dc3-856a-fb0531b3376c tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-9c385fed-452e-4ab5-93ff-20eb0b02a83e-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:41 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab Sep 04 19:22:41 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:41 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931" returned: 0 in 0.340s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:41 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 is being set with open permissions: ugo+rw Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:41 devstack sudo[105254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 Sep 04 19:22:41 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:41 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab" returned: 0 in 0.359s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:41 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab Sep 04 19:22:41 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:41 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:41 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.info Sep 04 19:22:41 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:42 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-0d3218dc-275f-42fc-9a01-79f4c16651ab" returned: 0 in 0.255s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Lock "cinder-quobyte-0d3218dc-275f-42fc-9a01-79f4c16651ab" released by "delete_volume" :: held 0.697s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Created reservations ['ad04862f-c3f7-4fd2-8b44-c15b136f4cc7', '78258910-823a-40bc-ab2a-7995143e7412', '6a205a67-8ea2-4d08-b9b2-6965dba0d12f', '8f25c62a-351f-44f7-80a8-a5de59346187'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:42 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.info" returned: 0 in 0.280s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:42 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.info is being set with open permissions: ugo+rw Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "cinder-8279aae0-1322-4abe-99a0-8e4aa52e07f9-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:42 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.info Sep 04 19:22:42 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-8279aae0-1322-4abe-99a0-8e4aa52e07f9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:42 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "cinder-quobyte-8279aae0-1322-4abe-99a0-8e4aa52e07f9" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:42 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-quobyte-8279aae0-1322-4abe-99a0-8e4aa52e07f9" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[daae6874-a797-4acc-8b6d-70bcd21f763f]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279aae0-1322-4abe-99a0-8e4aa52e07f9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Acquiring lock "cinder-94560779-3a7e-4214-8175-69b5482f5bcc-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Lock "cinder-94560779-3a7e-4214-8175-69b5482f5bcc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Acquiring lock "cinder-quobyte-94560779-3a7e-4214-8175-69b5482f5bcc" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:42 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279aae0-1322-4abe-99a0-8e4aa52e07f9 Sep 04 19:22:42 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Lock "cinder-quobyte-94560779-3a7e-4214-8175-69b5482f5bcc" acquired by "delete_volume" :: waited 0.049s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df1847e-ba04-4b5a-9a08-616b274e27e9]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94560779-3a7e-4214-8175-69b5482f5bcc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:42 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Flow 'volume_create_manager' (65b03b80-c26c-4e75-8688-c162573e0c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3c1500-4bae-4f3b-92d8-ecf4eb8e6dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.info" returned: 0 in 0.514s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.539s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3c1500-4bae-4f3b-92d8-ecf4eb8e6dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1220679627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61bb8daa-d59f-46c4-8f4c-88a888524da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20dc08b187b748febc2f29e04bc912bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:43Z,use_quota=True,user_id='f93ca64eaca44f519420e0bde5528d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25a8d6f-e0f6-4724-a61c-c9a14e7f95ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:42 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f25a8d6f-e0f6-4724-a61c-c9a14e7f95ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4438f2d1-2223-4643-a82c-d540d7be5cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4438f2d1-2223-4643-a82c-d540d7be5cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61bb8daa-d59f-46c4-8f4c-88a888524da8', 'volume_name': 'volume-61bb8daa-d59f-46c4-8f4c-88a888524da8', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b10a56-1702-4c74-8e9a-fc72ff4f2d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6b10a56-1702-4c74-8e9a-fc72ff4f2d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:42 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94560779-3a7e-4214-8175-69b5482f5bcc Sep 04 19:22:42 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ad7b08-64b3-4141-91a9-cfcd5ec3da10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:42 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Volume 61bb8daa-d59f-46c4-8f4c-88a888524da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61bb8daa-d59f-46c4-8f4c-88a888524da8', 'volume_size': 1} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1220679627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61bb8daa-d59f-46c4-8f4c-88a888524da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='20dc08b187b748febc2f29e04bc912bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:43Z,use_quota=True,user_id='f93ca64eaca44f519420e0bde5528d17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Creating volume 61bb8daa-d59f-46c4-8f4c-88a888524da8 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:42 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-61bb8daa-d59f-46c4-8f4c-88a888524da8 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.498s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Deleted volume successfully. Sep 04 19:22:42 devstack sudo[105277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-61bb8daa-d59f-46c4-8f4c-88a888524da8 1073741824 Sep 04 19:22:42 devstack sudo[105277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c55e1129-425a-4ebe-8c4c-254fca37200a tempest-VolumeDependencyTests-1741002841 None] Create snapshot completed successfully Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d2b1fd2d-de3c-45a1-9adf-2e2bfef53e62 tempest-CinderUnicodeTest-1986314301 None] Lock "cinder-0d3218dc-275f-42fc-9a01-79f4c16651ab-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:42 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279aae0-1322-4abe-99a0-8e4aa52e07f9" returned: 0 in 0.526s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279aae0-1322-4abe-99a0-8e4aa52e07f9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:42 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279aae0-1322-4abe-99a0-8e4aa52e07f9 Sep 04 19:22:42 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:43 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94560779-3a7e-4214-8175-69b5482f5bcc" returned: 0 in 0.396s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94560779-3a7e-4214-8175-69b5482f5bcc {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:43 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94560779-3a7e-4214-8175-69b5482f5bcc Sep 04 19:22:43 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:43 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279aae0-1322-4abe-99a0-8e4aa52e07f9" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-quobyte-8279aae0-1322-4abe-99a0-8e4aa52e07f9" released by "delete_volume" :: held 0.859s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:43 devstack sudo[105277]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-61bb8daa-d59f-46c4-8f4c-88a888524da8 1073741824" returned: 0 in 0.492s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Created reservations ['4793a4fe-2052-4917-957c-63eefab44428', '4eea3360-cc7f-4155-b4c0-558b4926bbf8', 'c84bd561-e125-4ef0-ab37-63a17238263a', '61cd0986-d84c-40fe-9897-5077e4476b51'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-94560779-3a7e-4214-8175-69b5482f5bcc" returned: 0 in 0.330s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:43 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-61bb8daa-d59f-46c4-8f4c-88a888524da8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Lock "cinder-quobyte-94560779-3a7e-4214-8175-69b5482f5bcc" released by "delete_volume" :: held 0.803s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:43 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-61bb8daa-d59f-46c4-8f4c-88a888524da8 Sep 04 19:22:43 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "cinder-90a92869-d45b-41f1-a147-d4a55a7a1e1d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-90a92869-d45b-41f1-a147-d4a55a7a1e1d-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Created reservations ['18fe2508-279c-4de0-a548-8e0c0e9bb87d', 'ad842c71-6a34-4333-b4af-c2c2adea83b7', '7ed48ed5-e1db-4ae6-871c-529034d28ab9', 'e9dbae8f-faaf-4085-ae83-481e32d49e88'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:43 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:43 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "cinder-quobyte-90a92869-d45b-41f1-a147-d4a55a7a1e1d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-quobyte-90a92869-d45b-41f1-a147-d4a55a7a1e1d" acquired by "delete_volume" :: waited 0.031s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc7c560-fd79-419b-b36f-8aeae8f19fb0]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-90a92869-d45b-41f1-a147-d4a55a7a1e1d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:43 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:43 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:43 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-61bb8daa-d59f-46c4-8f4c-88a888524da8" returned: 0 in 0.503s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ad7b08-64b3-4141-91a9-cfcd5ec3da10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61bb8daa-d59f-46c4-8f4c-88a888524da8', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2073887-3089-4da6-b2fa-7c59101541ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:43 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-90a92869-d45b-41f1-a147-d4a55a7a1e1d Sep 04 19:22:43 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:43 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.402s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Deleted volume successfully. Sep 04 19:22:43 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Volume volume-61bb8daa-d59f-46c4-8f4c-88a888524da8 (61bb8daa-d59f-46c4-8f4c-88a888524da8): created successfully Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2073887-3089-4da6-b2fa-7c59101541ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Flow 'volume_create_manager' (65b03b80-c26c-4e75-8688-c162573e0c6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-370d5cae-a73f-4035-aa5f-17598d7acf7b tempest-ProjectReaderTests-173221154 None] Created volume successfully. Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-afd383c4-ee5c-42fd-8e04-175da3622c57 tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-8279aae0-1322-4abe-99a0-8e4aa52e07f9-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:44 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.409s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Deleted volume successfully. Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0f8b30f7-bea3-4fcd-90fc-06c15bc95139 tempest-CinderUnicodeTest-1986314301 None] Lock "cinder-94560779-3a7e-4214-8175-69b5482f5bcc-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:44 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-90a92869-d45b-41f1-a147-d4a55a7a1e1d" returned: 0 in 0.549s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-90a92869-d45b-41f1-a147-d4a55a7a1e1d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:44 devstack sudo[105309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-90a92869-d45b-41f1-a147-d4a55a7a1e1d Sep 04 19:22:44 devstack sudo[105309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Flow 'volume_create_manager' (41cde394-0a87-4881-80db-f10453cca1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37d88c9-31d4-4885-ab6c-73ba0efce003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37d88c9-31d4-4885-ab6c-73ba0efce003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1786686981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e88046c-7223-4198-8134-9bc4b340490d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4855e44aa5da4953ac73443ec7b6e26c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3bbd2f8a-c68a-4793-bc30-89ba6269b931,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:44Z,use_quota=True,user_id='98288eee9b024ee6a4b590cd13d73035',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d854d5ba-8207-4e66-b692-e89f5bd93651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d854d5ba-8207-4e66-b692-e89f5bd93651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081d0012-69ab-4bb6-b714-0f39fa4137e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (081d0012-69ab-4bb6-b714-0f39fa4137e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3e88046c-7223-4198-8134-9bc4b340490d', 'volume_name': 'volume-3e88046c-7223-4198-8134-9bc4b340490d', 'volume_size': 1, 'snapshot_id': '3bbd2f8a-c68a-4793-bc30-89ba6269b931'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314622ed-829c-4ee6-ab2d-c2e8ecb5d825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (314622ed-829c-4ee6-ab2d-c2e8ecb5d825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d39fa5-1685-4901-a2b9-1324e5382744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:44 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Volume 3e88046c-7223-4198-8134-9bc4b340490d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3e88046c-7223-4198-8134-9bc4b340490d', 'volume_size': 1, 'snapshot_id': '3bbd2f8a-c68a-4793-bc30-89ba6269b931'} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "cinder-quobyte-3bbd2f8a-c68a-4793-bc30-89ba6269b931-3e88046c-7223-4198-8134-9bc4b340490d" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-quobyte-3bbd2f8a-c68a-4793-bc30-89ba6269b931-3e88046c-7223-4198-8134-9bc4b340490d" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Creating volume 3e88046c-7223-4198-8134-9bc4b340490d from snapshot 3bbd2f8a-c68a-4793-bc30-89ba6269b931 {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "cinder-quobyte-3e88046c-7223-4198-8134-9bc4b340490d" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-quobyte-3e88046c-7223-4198-8134-9bc4b340490d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] snapshot: 3bbd2f8a-c68a-4793-bc30-89ba6269b931, volume: 3e88046c-7223-4198-8134-9bc4b340490d, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8b9f10-e627-4051-a666-33166ac82e5b]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:44 devstack sudo[105309]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-90a92869-d45b-41f1-a147-d4a55a7a1e1d" returned: 0 in 0.293s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-quobyte-90a92869-d45b-41f1-a147-d4a55a7a1e1d" released by "delete_volume" :: held 0.912s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Created reservations ['dc6aa7f7-b5aa-4a4c-918a-e170d2073e60', 'd01ea353-5c12-46f4-b354-5fe92140ce2f', 'ae64a969-0f36-4ef0-aec4-71afcdf7d9f6', '2a23f7f9-4d66-43ca-8904-e9ef17d1e102'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:44 devstack sudo[105312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 Sep 04 19:22:44 devstack sudo[105312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:44 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:44 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Acquiring lock "cinder-61bb8daa-d59f-46c4-8f4c-88a888524da8-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Lock "cinder-61bb8daa-d59f-46c4-8f4c-88a888524da8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Acquiring lock "cinder-quobyte-61bb8daa-d59f-46c4-8f4c-88a888524da8" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Lock "cinder-quobyte-61bb8daa-d59f-46c4-8f4c-88a888524da8" acquired by "delete_volume" :: waited 0.025s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[46404e71-d9f0-4874-aa12-7f916da1b167]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-61bb8daa-d59f-46c4-8f4c-88a888524da8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:45 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.358s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:45 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Deleted volume successfully. Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-58c3cbb4-e0c6-48aa-b51d-8c66034f6a1b tempest-CreateVolumesFromSourceVolumeTest-600374258 None] Lock "cinder-90a92869-d45b-41f1-a147-d4a55a7a1e1d-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:45 devstack sudo[105312]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931" returned: 0 in 0.659s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:22:45 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-61bb8daa-d59f-46c4-8f4c-88a888524da8 Sep 04 19:22:45 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f629659-7fd1-4bb0-a57b-4fedd8c67549]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:45 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:45 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:45 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 Sep 04 19:22:45 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:45 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.426s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:22:45 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-61bb8daa-d59f-46c4-8f4c-88a888524da8" returned: 0 in 0.617s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-61bb8daa-d59f-46c4-8f4c-88a888524da8 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:45 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-61bb8daa-d59f-46c4-8f4c-88a888524da8 Sep 04 19:22:45 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:45 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66" returned: 0 in 0.605s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Path /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3e88046c-7223-4198-8134-9bc4b340490d not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 19:22:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3e88046c-7223-4198-8134-9bc4b340490d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:45 devstack sudo[105338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3e88046c-7223-4198-8134-9bc4b340490d Sep 04 19:22:45 devstack sudo[105338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:46 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-61bb8daa-d59f-46c4-8f4c-88a888524da8" returned: 0 in 0.405s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Lock "cinder-quobyte-61bb8daa-d59f-46c4-8f4c-88a888524da8" released by "delete_volume" :: held 1.100s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:46 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Created reservations ['11a990cd-b513-4574-89d9-14dc722fce6d', 'fe4d5449-3b1a-4025-84f4-819f03db8875', '517512e9-3ee9-4765-83e6-2840f26e1ec3', '6336bdae-1da3-4359-868d-8b58dabdd61a'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:46 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:46 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:46 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.654s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:46 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Deleted volume successfully. Sep 04 19:22:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-deb66a0e-b3ff-4ad4-ba1e-ad9b4ff31cf5 tempest-ProjectReaderTests-173221154 None] Lock "cinder-61bb8daa-d59f-46c4-8f4c-88a888524da8-delete_volume" released by "delete_volume" :: held 2.152s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:51 devstack sudo[105338]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3e88046c-7223-4198-8134-9bc4b340490d" returned: 0 in 5.689s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:51 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3e88046c-7223-4198-8134-9bc4b340490d {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:22:51 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Converted 1024.00 MB image at 179.92 MB/s Sep 04 19:22:51 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3e88046c-7223-4198-8134-9bc4b340490d is being set with open permissions: ugo+rw Sep 04 19:22:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3e88046c-7223-4198-8134-9bc4b340490d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:51 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3e88046c-7223-4198-8134-9bc4b340490d Sep 04 19:22:51 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:51 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3e88046c-7223-4198-8134-9bc4b340490d" returned: 0 in 0.278s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-quobyte-3e88046c-7223-4198-8134-9bc4b340490d" released by "_copy_volume_from_snapshot" :: held 7.349s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-quobyte-3bbd2f8a-c68a-4793-bc30-89ba6269b931-3e88046c-7223-4198-8134-9bc4b340490d" released by "_create_volume_from_snapshot" :: held 7.425s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.440s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1d39fa5-1685-4901-a2b9-1324e5382744) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e88046c-7223-4198-8134-9bc4b340490d', 'volume_size': 1, 'snapshot_id': '3bbd2f8a-c68a-4793-bc30-89ba6269b931'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (becc09b7-cd4e-4e2a-b903-18ac9d58c4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:51 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Volume volume-3e88046c-7223-4198-8134-9bc4b340490d (3e88046c-7223-4198-8134-9bc4b340490d): created successfully Sep 04 19:22:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (becc09b7-cd4e-4e2a-b903-18ac9d58c4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:51 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Flow 'volume_create_manager' (41cde394-0a87-4881-80db-f10453cca1f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a25e09ce-a3bb-4056-a39c-257d7a121b22 tempest-VolumeDependencyTests-1741002841 None] Created volume successfully. Sep 04 19:22:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "cinder-3bbd2f8a-c68a-4793-bc30-89ba6269b931-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-3bbd2f8a-c68a-4793-bc30-89ba6269b931-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "cinder-quobyte-03a33a3f-ae42-48c2-bfec-f607e9aa2d66" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-quobyte-03a33a3f-ae42-48c2-bfec-f607e9aa2d66" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "cinder-quobyte-3bbd2f8a-c68a-4793-bc30-89ba6269b931" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-quobyte-3bbd2f8a-c68a-4793-bc30-89ba6269b931" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Deleting offline snapshot 3bbd2f8a-c68a-4793-bc30-89ba6269b931 of volume 03a33a3f-ae42-48c2-bfec-f607e9aa2d66 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:22:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] snapshot_file for this snap is: volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:22:52 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[626c03d4-48b8-4068-b9d9-b33267190cf6]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:52 devstack sudo[105365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 Sep 04 19:22:52 devstack sudo[105365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:52 devstack sudo[105365]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931" returned: 0 in 0.400s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:52 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:22:52 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd0590f-6af5-49db-b75b-111ac6fdf1be]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:52 devstack sudo[105372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 Sep 04 19:22:52 devstack sudo[105372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:53 devstack sudo[105372]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66" returned: 0 in 0.658s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:53 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 Sep 04 19:22:53 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:53 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931" returned: 0 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:53 devstack sudo[105383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931 Sep 04 19:22:53 devstack sudo[105383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:54 devstack sudo[105383]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66.3bbd2f8a-c68a-4793-bc30-89ba6269b931" returned: 0 in 0.305s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-quobyte-3bbd2f8a-c68a-4793-bc30-89ba6269b931" released by "_delete_snapshot" :: held 1.897s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-quobyte-03a33a3f-ae42-48c2-bfec-f607e9aa2d66" released by "delete_snapshot" :: held 1.926s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:54 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Created reservations ['3b336621-4d76-46ca-8b51-9a2db98b94ab', '426312cd-1150-453c-b101-c15716cfc10a', 'e30c643a-25b5-49e7-854f-c108903c84cc', '53a29763-26c7-435d-970e-7eadb4b45f97'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Delete snapshot completed successfully. Sep 04 19:22:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-14bfc09d-504e-43ad-8aa2-99384090f33d tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-3bbd2f8a-c68a-4793-bc30-89ba6269b931-delete_snapshot" released by "delete_snapshot" :: held 2.122s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "cinder-03a33a3f-ae42-48c2-bfec-f607e9aa2d66-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-03a33a3f-ae42-48c2-bfec-f607e9aa2d66-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "cinder-quobyte-03a33a3f-ae42-48c2-bfec-f607e9aa2d66" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:54 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-quobyte-03a33a3f-ae42-48c2-bfec-f607e9aa2d66" acquired by "delete_volume" :: waited 0.033s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:54 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fab7172-8dda-414c-a52d-6279c5400b1e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:54 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 Sep 04 19:22:54 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Flow 'volume_create_manager' (2fd099f7-bc49-4f9e-9516-55c4d3725925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab2b7c5-3b95-42e5-8995-2548c088ad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab2b7c5-3b95-42e5-8995-2548c088ad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8279013b-025a-4757-8eba-d40859ac8918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21f029f76fb43e0bd8fbd4d61ed5b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:55Z,use_quota=True,user_id='c4a222595b0048ea929eb32cccd2bccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec016356-0c27-436c-94ce-f0b3f66cefe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec016356-0c27-436c-94ce-f0b3f66cefe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3730d20e-1881-4e33-8a3b-5ad12dd1455c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.image.glance [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Creating Keystone auth plugin from conf {{(pid=87560) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 04 19:22:55 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66" returned: 0 in 0.464s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:55 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66 Sep 04 19:22:55 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:55 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-03a33a3f-ae42-48c2-bfec-f607e9aa2d66" returned: 0 in 0.289s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-quobyte-03a33a3f-ae42-48c2-bfec-f607e9aa2d66" released by "delete_volume" :: held 0.838s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Created reservations ['ca88cef8-6821-45b8-857c-3433c9ede2b0', 'ef8f9b07-e7fa-4694-aff1-aa087f0db3bb', 'befd29b4-1f65-4c05-a8c4-987210aba96c', 'b9f6f434-23ae-45fe-83cb-9758f3b00796'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3730d20e-1881-4e33-8a3b-5ad12dd1455c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8279013b-025a-4757-8eba-d40859ac8918', 'volume_name': 'volume-8279013b-025a-4757-8eba-d40859ac8918', 'volume_size': 1, 'image_id': '3aceac58-15f4-4652-b7b2-49412b89c542', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3aceac58-15f4-4652-b7b2-49412b89c542', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c52c6672fa4dc58f7864a24e86540f4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b21f029f76fb43e0bd8fbd4d61ed5b40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e0f68ab4bc7565b7903d55c8fbf7476f5adfc96392402d9b60aa4785a22af1eefce1e2eab1a8a3cf46b6e0b98930c91038e642e28029bac76ee7b152f8ce1fe1', 'id': '3aceac58-15f4-4652-b7b2-49412b89c542', 'created_at': datetime.datetime(2026, 9, 4, 17, 22, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 17, 22, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3aceac58-15f4-4652-b7b2-49412b89c542/file', 'properties': {}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492fb4c9-1555-447a-a796-c4c0831dcd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:55 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:55 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (492fb4c9-1555-447a-a796-c4c0831dcd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1248b0c3-47c4-4fbd-9333-c1c53adc3142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:55 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Volume 8279013b-025a-4757-8eba-d40859ac8918: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8279013b-025a-4757-8eba-d40859ac8918', 'volume_size': 1, 'image_id': '3aceac58-15f4-4652-b7b2-49412b89c542', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3aceac58-15f4-4652-b7b2-49412b89c542', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c52c6672fa4dc58f7864a24e86540f4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b21f029f76fb43e0bd8fbd4d61ed5b40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e0f68ab4bc7565b7903d55c8fbf7476f5adfc96392402d9b60aa4785a22af1eefce1e2eab1a8a3cf46b6e0b98930c91038e642e28029bac76ee7b152f8ce1fe1', 'id': '3aceac58-15f4-4652-b7b2-49412b89c542', 'created_at': datetime.datetime(2026, 9, 4, 17, 22, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 17, 22, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3aceac58-15f4-4652-b7b2-49412b89c542/file', 'properties': {}}, 'image_service': } Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Trying to clone 8279013b-025a-4757-8eba-d40859ac8918 from image 3aceac58-15f4-4652-b7b2-49412b89c542 at location (None, [{'url': 'file:///opt/stack/data/glance/images/3aceac58-15f4-4652-b7b2-49412b89c542', 'metadata': {}}]). {{(pid=87560) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "cinder-3e88046c-7223-4198-8134-9bc4b340490d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-3e88046c-7223-4198-8134-9bc4b340490d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 04 19:22:55 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Image download 0.00 MB at 0.00 MB/s Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "cinder-quobyte-3e88046c-7223-4198-8134-9bc4b340490d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1193a73b-aa22-4d57-ac57-41d09342d5ac]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-quobyte-3e88046c-7223-4198-8134-9bc4b340490d" acquired by "delete_volume" :: waited 0.034s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce233322-48c4-4aca-8107-96f679041d0f]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3e88046c-7223-4198-8134-9bc4b340490d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:55 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.331s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:55 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:55 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Deleted volume successfully. Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-48f422aa-65c0-4fac-8977-b530239cfff6 tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-03a33a3f-ae42-48c2-bfec-f607e9aa2d66-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:56 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD Sep 04 19:22:56 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:56 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3e88046c-7223-4198-8134-9bc4b340490d Sep 04 19:22:56 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:56 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:56 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3e88046c-7223-4198-8134-9bc4b340490d" returned: 0 in 0.403s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3e88046c-7223-4198-8134-9bc4b340490d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:56 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3e88046c-7223-4198-8134-9bc4b340490d Sep 04 19:22:56 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:56 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD Sep 04 19:22:56 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:56 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Temporary image 3aceac58-15f4-4652-b7b2-49412b89c542 is fetched for user c4a222595b0048ea929eb32cccd2bccb. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 04 19:22:56 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-3e88046c-7223-4198-8134-9bc4b340490d" returned: 0 in 0.278s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-quobyte-3e88046c-7223-4198-8134-9bc4b340490d" released by "delete_volume" :: held 0.733s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70fc5c2-ed0b-413f-a522-a79e1d736945]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Created reservations ['86657cfc-75ad-4a42-a417-8a7a56c97fb7', 'a594e203-67db-4022-b393-2798edab057d', 'd2f1c0e0-b1c4-4d75-8eaf-629028e1be14', '40202be2-ea16-44aa-8aeb-cc3884e99ec3'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:56 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD Sep 04 19:22:56 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:56 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:22:56 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:22:56 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (3d024537-741f-43d7-811e-0fc86c34445f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260dbec5-d1cc-48d8-acee-4b8ace148465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (260dbec5-d1cc-48d8-acee-4b8ace148465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1946740437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741bfe8b-406c-40de-81d2-897b380e65a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:57Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ab3a33-ac2f-4b98-a6ed-118a06b2ce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94ab3a33-ac2f-4b98-a6ed-118a06b2ce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2541d4b4-a7fe-4068-b5b2-cd0cfb77203e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2541d4b4-a7fe-4068-b5b2-cd0cfb77203e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '741bfe8b-406c-40de-81d2-897b380e65a2', 'volume_name': 'volume-741bfe8b-406c-40de-81d2-897b380e65a2', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a39c6e-8e81-41e3-b973-77372c68f3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53a39c6e-8e81-41e3-b973-77372c68f3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c623489d-55e4-49f2-892a-ac1f7373c323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:57 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Volume 741bfe8b-406c-40de-81d2-897b380e65a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-741bfe8b-406c-40de-81d2-897b380e65a2', 'volume_size': 1} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1946740437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=741bfe8b-406c-40de-81d2-897b380e65a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:57Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Creating volume 741bfe8b-406c-40de-81d2-897b380e65a2 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:57 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:57 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:57 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2 1073741824 Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.285s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:22:57 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Deleted volume successfully. Sep 04 19:22:57 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-62a9def3-fb04-442c-a8fb-d4ee0399eaf7 tempest-VolumeDependencyTests-1741002841 None] Lock "cinder-3e88046c-7223-4198-8134-9bc4b340490d-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:22:57 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD Sep 04 19:22:57 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:57 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:57 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2 1073741824" returned: 0 in 0.444s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=232,cinder:INSERT=86,cinder:UPDATE=333,cinder:DELETE=27 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:57 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2 Sep 04 19:22:57 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:57 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2" returned: 0 in 0.246s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.302s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8279013b-025a-4757-8eba-d40859ac8918,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b21f029f76fb43e0bd8fbd4d61ed5b40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:22:55Z,use_quota=True,user_id='c4a222595b0048ea929eb32cccd2bccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Creating volume 8279013b-025a-4757-8eba-d40859ac8918 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:22:57 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c623489d-55e4-49f2-892a-ac1f7373c323) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-741bfe8b-406c-40de-81d2-897b380e65a2', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f63e561-8e58-46c4-a6bd-06cd89f89ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:22:57 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918 1073741824 Sep 04 19:22:57 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:57 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Volume volume-741bfe8b-406c-40de-81d2-897b380e65a2 (741bfe8b-406c-40de-81d2-897b380e65a2): created successfully Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f63e561-8e58-46c4-a6bd-06cd89f89ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (3d024537-741f-43d7-811e-0fc86c34445f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:22:57 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=238,cinder:UPDATE=334,cinder:INSERT=81,cinder:DELETE=32 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:22:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e292b6d4-a19a-42e2-b3b9-ea310786191c tempest-ProjectMemberTests-663374494 None] Created volume successfully. Sep 04 19:22:58 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918 1073741824" returned: 0 in 0.544s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:58 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918 Sep 04 19:22:58 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:22:58 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918" returned: 0 in 0.281s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:22:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:22:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.189s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:22:58 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] Creating offline snapshot bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f of volume 741bfe8b-406c-40de-81d2-897b380e65a2 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:22:58 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Attempting download of 3aceac58-15f4-4652-b7b2-49412b89c542 ((None, [{'url': 'file:///opt/stack/data/glance/images/3aceac58-15f4-4652-b7b2-49412b89c542', 'metadata': {}}])) to volume 8279013b-025a-4757-8eba-d40859ac8918. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 04 19:22:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d137c3-5f43-4ca8-a6e8-5890a6a4e456]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:58 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b82face-f14d-4e55-b9bc-cad6486777ef]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3aceac58-15f4-4652-b7b2-49412b89c542_7mg7eozj {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:58 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2 Sep 04 19:22:58 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:58 devstack sudo[105448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3aceac58-15f4-4652-b7b2-49412b89c542_7mg7eozj Sep 04 19:22:58 devstack sudo[105448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:59 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2" returned: 0 in 0.385s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:59 devstack sudo[105448]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_3aceac58-15f4-4652-b7b2-49412b89c542_7mg7eozj" returned: 0 in 0.352s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3aceac58-15f4-4652-b7b2-49412b89c542_7mg7eozj {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:59 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f 1G Sep 04 19:22:59 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:59 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3aceac58-15f4-4652-b7b2-49412b89c542_7mg7eozj Sep 04 19:22:59 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:59 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3aceac58-15f4-4652-b7b2-49412b89c542_7mg7eozj" returned: 1 in 0.367s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_3aceac58-15f4-4652-b7b2-49412b89c542_7mg7eozj' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:22:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9e6b0c-2f8c-4e2a-abac-f2f8244b3cab]: (4, 'raw') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:22:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:59 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f 1G" returned: 0 in 0.466s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-741bfe8b-406c-40de-81d2-897b380e65a2 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:59 devstack sudo[105467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-741bfe8b-406c-40de-81d2-897b380e65a2 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f Sep 04 19:22:59 devstack sudo[105467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:59 devstack sudo[105466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD Sep 04 19:22:59 devstack sudo[105466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:59 devstack sudo[105466]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD" returned: 0 in 0.359s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:59 devstack sudo[105467]: pam_unix(sudo:session): session closed for user root Sep 04 19:22:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-741bfe8b-406c-40de-81d2-897b380e65a2 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f" returned: 0 in 0.301s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:22:59 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f is being set with open permissions: ugo+rw Sep 04 19:22:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:22:59 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f Sep 04 19:22:59 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:22:59 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD Sep 04 19:22:59 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:00 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f" returned: 0 in 0.264s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:00 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.info Sep 04 19:23:00 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:00 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD" returned: 1 in 0.371s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 04 19:23:00 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] 3aceac58-15f4-4652-b7b2-49412b89c542 was raw, converting to qcow2 {{(pid=87560) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 04 19:23:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:00 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918 Sep 04 19:23:00 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:00 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.info" returned: 0 in 0.277s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:00 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.info is being set with open permissions: ugo+rw Sep 04 19:23:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:00 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.info Sep 04 19:23:00 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:00 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918" returned: 0 in 0.472s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:00 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_3aceac58-15f4-4652-b7b2-49412b89c542_zsim3vhtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:23:00 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Converted 0.00 MB image at 0.00 MB/s Sep 04 19:23:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:00 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.info" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:00 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918 1G Sep 04 19:23:00 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.066s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-884b4bc5-73f6-4490-b002-59e88950d59d tempest-ProjectMemberTests-663374494 None] Create snapshot completed successfully Sep 04 19:23:01 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918 1G" returned: 0 in 0.326s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Downloaded image 3aceac58-15f4-4652-b7b2-49412b89c542 ((None, [{'url': 'file:///opt/stack/data/glance/images/3aceac58-15f4-4652-b7b2-49412b89c542', 'metadata': {}}])) to volume 8279013b-025a-4757-8eba-d40859ac8918 successfully. {{(pid=87560) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Temporary image 3aceac58-15f4-4652-b7b2-49412b89c542 for user c4a222595b0048ea929eb32cccd2bccb is deleted. {{(pid=87560) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.volume.volume_utils [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Marking volume 8279013b-025a-4757-8eba-d40859ac8918 as bootable. {{(pid=87560) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Copying metadata from image 3aceac58-15f4-4652-b7b2-49412b89c542 to 8279013b-025a-4757-8eba-d40859ac8918. {{(pid=87560) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Creating volume glance metadata for volume 8279013b-025a-4757-8eba-d40859ac8918 backed by image 3aceac58-15f4-4652-b7b2-49412b89c542 with: {'image_id': '3aceac58-15f4-4652-b7b2-49412b89c542', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7c52c6672fa4dc58f7864a24e86540f4', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87560) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1248b0c3-47c4-4fbd-9333-c1c53adc3142) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8279013b-025a-4757-8eba-d40859ac8918', 'volume_size': 1, 'image_id': '3aceac58-15f4-4652-b7b2-49412b89c542', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/3aceac58-15f4-4652-b7b2-49412b89c542', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7c52c6672fa4dc58f7864a24e86540f4', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b21f029f76fb43e0bd8fbd4d61ed5b40', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'e0f68ab4bc7565b7903d55c8fbf7476f5adfc96392402d9b60aa4785a22af1eefce1e2eab1a8a3cf46b6e0b98930c91038e642e28029bac76ee7b152f8ce1fe1', 'id': '3aceac58-15f4-4652-b7b2-49412b89c542', 'created_at': datetime.datetime(2026, 9, 4, 17, 22, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 4, 17, 22, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/3aceac58-15f4-4652-b7b2-49412b89c542/file', 'properties': {}}, 'image_service': }' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61eaa5f-feec-4e03-bf67-de235eedfa27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:01 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Volume volume-8279013b-025a-4757-8eba-d40859ac8918 (8279013b-025a-4757-8eba-d40859ac8918): created successfully Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f61eaa5f-feec-4e03-bf67-de235eedfa27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Flow 'volume_create_manager' (2fd099f7-bc49-4f9e-9516-55c4d3725925) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-03c2e94e-c69e-41b9-87c8-8f7d689b918f tempest-VolumeImageDependencyTests-88489249 None] Created volume successfully. Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Acquiring lock "cinder-8279013b-025a-4757-8eba-d40859ac8918-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Lock "cinder-8279013b-025a-4757-8eba-d40859ac8918-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Acquiring lock "cinder-quobyte-8279013b-025a-4757-8eba-d40859ac8918" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Lock "cinder-quobyte-8279013b-025a-4757-8eba-d40859ac8918" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c192df-063f-413d-b53c-47843a530c71]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Lock "cinder-bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-741bfe8b-406c-40de-81d2-897b380e65a2" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-741bfe8b-406c-40de-81d2-897b380e65a2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Deleting offline snapshot bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f of volume 741bfe8b-406c-40de-81d2-897b380e65a2 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] snapshot_file for this snap is: volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:23:01 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918 Sep 04 19:23:01 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a8650b-1601-48f9-ab02-ab4b8403a175]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:01 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f Sep 04 19:23:01 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:02 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918" returned: 0 in 0.408s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:02 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918 Sep 04 19:23:02 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:02 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f" returned: 0 in 0.389s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-741bfe8b-406c-40de-81d2-897b380e65a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69262bc-0f99-4932-9daf-9effd0729d5a]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:02 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-8279013b-025a-4757-8eba-d40859ac8918" returned: 0 in 0.262s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:02 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2 Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Lock "cinder-quobyte-8279013b-025a-4757-8eba-d40859ac8918" released by "delete_volume" :: held 0.724s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:02 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Created reservations ['535a6187-da70-456d-b038-2169452a9017', 'ac924b41-7e50-4a4f-8be0-c830f6b0643d', 'c6637bba-56ed-4102-b1fe-c63085c14091', '261d10fc-3a26-464f-869c-7df9a2d1e95d'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:02 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:23:02 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:02 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2" returned: 0 in 0.458s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:02 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f Sep 04 19:23:02 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:02 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.290s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:23:02 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Deleted volume successfully. Sep 04 19:23:02 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e1d49014-e873-41c9-8109-0ccf363cee0e tempest-VolumeImageDependencyTests-88489249 None] Lock "cinder-8279013b-025a-4757-8eba-d40859ac8918-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:03 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f" returned: 0 in 0.431s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:03 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f Sep 04 19:23:03 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:03 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2.bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f" returned: 0 in 0.280s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f" released by "_delete_snapshot" :: held 1.674s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-741bfe8b-406c-40de-81d2-897b380e65a2" released by "delete_snapshot" :: held 1.705s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:03 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Created reservations ['00cfe751-6f5d-4e35-bf1e-9226c5e3aded', '329f6256-a4e7-4475-9400-00dcc596251a', '4364f3d2-98f7-41ac-87f2-ecac4357d39a', 'c22a92d5-69fe-4f5c-80f3-00f67432b00c'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:03 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Delete snapshot completed successfully. Sep 04 19:23:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-98b69e0b-0ead-41b7-8bcc-60fe74a1fb60 tempest-ProjectMemberTests-663374494 None] Lock "cinder-bc7d5cf1-027f-428e-8bca-f2cb4af6bd6f-delete_snapshot" released by "delete_snapshot" :: held 1.875s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-741bfe8b-406c-40de-81d2-897b380e65a2-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Lock "cinder-741bfe8b-406c-40de-81d2-897b380e65a2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-741bfe8b-406c-40de-81d2-897b380e65a2" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:03 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-741bfe8b-406c-40de-81d2-897b380e65a2" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:03 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd014f46-2f6f-4753-9251-2271ceaf0803]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:04 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2 Sep 04 19:23:04 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:04 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2" returned: 0 in 0.417s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:04 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2 Sep 04 19:23:04 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:04 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-741bfe8b-406c-40de-81d2-897b380e65a2" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-741bfe8b-406c-40de-81d2-897b380e65a2" released by "delete_volume" :: held 0.744s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:04 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Created reservations ['2ef725dc-2d8a-4225-b5a7-a5a936c2a877', 'e6637a74-a690-4878-9b03-6be24fb0be52', 'f91d7bc0-3359-46ba-b831-2efd5894bd86', '68525a83-abd5-4569-84a9-afaec5f7da18'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:04 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:23:04 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:05 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.308s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:23:05 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Deleted volume successfully. Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-27d35fcc-a477-425c-9040-d11c5825d08f tempest-ProjectMemberTests-663374494 None] Lock "cinder-741bfe8b-406c-40de-81d2-897b380e65a2-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (479c1639-b181-48c5-9729-5462de345d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabe10b9-ceb4-4a4c-bb1e-d75a209b591f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabe10b9-ceb4-4a4c-bb1e-d75a209b591f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-159733361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16840d38-152b-439f-8517-dc04f9f1f58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:06Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74eead3e-0c95-47de-aa78-3b621a577c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74eead3e-0c95-47de-aa78-3b621a577c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbcc183-3718-4a2d-bf8a-099eeae96819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbcc183-3718-4a2d-bf8a-099eeae96819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16840d38-152b-439f-8517-dc04f9f1f58e', 'volume_name': 'volume-16840d38-152b-439f-8517-dc04f9f1f58e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f7a82e-3f6c-4fb8-9ef2-6c067679e09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f7a82e-3f6c-4fb8-9ef2-6c067679e09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59955454-6d4e-4951-be1f-eb21dbc6373b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:05 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Volume 16840d38-152b-439f-8517-dc04f9f1f58e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16840d38-152b-439f-8517-dc04f9f1f58e', 'volume_size': 1} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-159733361',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16840d38-152b-439f-8517-dc04f9f1f58e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:06Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Creating volume 16840d38-152b-439f-8517-dc04f9f1f58e {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:23:05 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:23:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:05 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e 1073741824 Sep 04 19:23:05 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Flow 'volume_create_manager' (3e25bcaa-6bb2-4c15-bc7c-2e3d6f7d0006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8314c76d-43d2-488b-9a6f-6cbf8db7f89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:06 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e 1073741824" returned: 0 in 0.490s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8314c76d-43d2-488b-9a6f-6cbf8db7f89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-529952971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57daa840-af64-423e-ad5d-f3bd154cf596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8ac596ef434e45b73c95b8f1cedd5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:06Z,use_quota=True,user_id='257b87666f6f43cbb53034b9d911eee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9df64a1-3d34-497d-8dc5-1a2d337ed6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9df64a1-3d34-497d-8dc5-1a2d337ed6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f87a79-6aa5-4df5-b917-e2330b68b04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f87a79-6aa5-4df5-b917-e2330b68b04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57daa840-af64-423e-ad5d-f3bd154cf596', 'volume_name': 'volume-57daa840-af64-423e-ad5d-f3bd154cf596', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540b4f82-1008-48f7-8950-0889b8952a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (540b4f82-1008-48f7-8950-0889b8952a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc766005-9ce1-4ee3-99ba-82096a47818d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:06 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Volume 57daa840-af64-423e-ad5d-f3bd154cf596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57daa840-af64-423e-ad5d-f3bd154cf596', 'volume_size': 1} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:06 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e Sep 04 19:23:06 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-73d35550-fe3a-47df-b03f-3db7c7ed0317 tempest-ProjectAdminTests-226443926 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.7298393249512, 'free_capacity_gb': 1773.7298393249512, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87560) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 04 19:23:06 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e" returned: 0 in 0.263s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.282s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-529952971',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57daa840-af64-423e-ad5d-f3bd154cf596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8ac596ef434e45b73c95b8f1cedd5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:06Z,use_quota=True,user_id='257b87666f6f43cbb53034b9d911eee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Creating volume 57daa840-af64-423e-ad5d-f3bd154cf596 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:23:06 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59955454-6d4e-4951-be1f-eb21dbc6373b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16840d38-152b-439f-8517-dc04f9f1f58e', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:06 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596 1073741824 Sep 04 19:23:06 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770ae5f6-1832-4adb-a840-e16cfef84a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:06 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Volume volume-16840d38-152b-439f-8517-dc04f9f1f58e (16840d38-152b-439f-8517-dc04f9f1f58e): created successfully Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (770ae5f6-1832-4adb-a840-e16cfef84a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (479c1639-b181-48c5-9729-5462de345d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:06 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-995b1483-50f3-4221-b09a-be5511e9ca27 tempest-ProjectMemberTests-663374494 None] Created volume successfully. Sep 04 19:23:06 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596 1073741824" returned: 0 in 0.444s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:07 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596 Sep 04 19:23:07 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:07 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:23:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc766005-9ce1-4ee3-99ba-82096a47818d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57daa840-af64-423e-ad5d-f3bd154cf596', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84107f7-bb72-4e82-b3d0-103ecd4e84ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:07 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Volume volume-57daa840-af64-423e-ad5d-f3bd154cf596 (57daa840-af64-423e-ad5d-f3bd154cf596): created successfully Sep 04 19:23:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d84107f7-bb72-4e82-b3d0-103ecd4e84ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:07 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Flow 'volume_create_manager' (3e25bcaa-6bb2-4c15-bc7c-2e3d6f7d0006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0fbe2a4b-7375-4dfe-a705-60f0d666b5b3 tempest-ProjectReaderTests-571161266 None] Created volume successfully. Sep 04 19:23:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] Creating offline snapshot 87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 of volume 16840d38-152b-439f-8517-dc04f9f1f58e {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:23:07 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85582c4-65e8-49cd-aeb4-a68547f94cf1]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:07 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e Sep 04 19:23:07 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:08 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e" returned: 0 in 0.389s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:08 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 1G Sep 04 19:23:08 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:08 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 1G" returned: 0 in 0.453s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:08 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16840d38-152b-439f-8517-dc04f9f1f58e -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:08 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16840d38-152b-439f-8517-dc04f9f1f58e -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 Sep 04 19:23:08 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:09 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16840d38-152b-439f-8517-dc04f9f1f58e -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9" returned: 0 in 0.294s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:09 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 is being set with open permissions: ugo+rw Sep 04 19:23:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:09 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 Sep 04 19:23:09 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:09 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9" returned: 0 in 0.252s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:09 devstack sudo[105580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.info Sep 04 19:23:09 devstack sudo[105580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:09 devstack sudo[105580]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.info" returned: 0 in 0.248s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:09 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.info is being set with open permissions: ugo+rw Sep 04 19:23:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:09 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.info Sep 04 19:23:09 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:09 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.info" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.366s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:09 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] Creating offline snapshot 870fcd56-4e1c-4639-8b8b-0fd0338a6157 of volume 57daa840-af64-423e-ad5d-f3bd154cf596 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:23:09 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f8f6cc1d-37f4-4041-9942-0aa63b709165 tempest-ProjectMemberTests-663374494 None] Create snapshot completed successfully Sep 04 19:23:09 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0186253-4942-4297-b044-71c2f6ca0635]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:09 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Lock "cinder-87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:09 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-16840d38-152b-439f-8517-dc04f9f1f58e" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:10 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596 Sep 04 19:23:10 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-16840d38-152b-439f-8517-dc04f9f1f58e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Deleting offline snapshot 87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 of volume 16840d38-152b-439f-8517-dc04f9f1f58e {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] snapshot_file for this snap is: volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a677f150-f921-4591-9a4a-e5ee2b549353]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:10 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 Sep 04 19:23:10 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:10 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596" returned: 0 in 0.378s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:10 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157 1G Sep 04 19:23:10 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:10 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9" returned: 0 in 0.378s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16840d38-152b-439f-8517-dc04f9f1f58e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4350a2-7ab0-446a-a77b-d441881d9cee]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:10 devstack sudo[105600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e Sep 04 19:23:10 devstack sudo[105600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:10 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157 1G" returned: 0 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57daa840-af64-423e-ad5d-f3bd154cf596 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:10 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57daa840-af64-423e-ad5d-f3bd154cf596 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157 Sep 04 19:23:10 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:10 devstack sudo[105600]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e" returned: 0 in 0.376s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:10 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 Sep 04 19:23:10 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:10 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57daa840-af64-423e-ad5d-f3bd154cf596 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157" returned: 0 in 0.320s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:10 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157 is being set with open permissions: ugo+rw Sep 04 19:23:10 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:10 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157 Sep 04 19:23:10 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:11 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:11 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157" returned: 0 in 0.283s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9" returned: 0 in 0.404s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:11 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9 Sep 04 19:23:11 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:11 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.info Sep 04 19:23:11 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:11 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e.87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9" returned: 0 in 0.290s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:11 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.info" returned: 0 in 0.301s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:11 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.info is being set with open permissions: ugo+rw Sep 04 19:23:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9" released by "_delete_snapshot" :: held 1.569s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-16840d38-152b-439f-8517-dc04f9f1f58e" released by "delete_snapshot" :: held 1.596s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:11 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.info Sep 04 19:23:11 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:11 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Created reservations ['9ba3ee21-cfa6-48d9-b477-75fb9e474e4c', '24801769-c9ef-4de7-a996-b76a4070d71f', 'aa6809b6-607e-457f-b507-ab5c074cbad3', '91df728e-ec1c-4e8d-b988-d186be76253f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Delete snapshot completed successfully. Sep 04 19:23:11 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-26bad8a6-4358-4011-a7d2-0f66040f9790 tempest-ProjectMemberTests-663374494 None] Lock "cinder-87ae1b93-7cc7-49c8-8e22-02fd7e4fefb9-delete_snapshot" released by "delete_snapshot" :: held 1.753s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:11 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.info" returned: 0 in 0.304s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:11 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.070s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:11 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e6bf7ea1-fc46-429e-8219-77ba83ed8f57 tempest-ProjectReaderTests-571161266 None] Create snapshot completed successfully Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-16840d38-152b-439f-8517-dc04f9f1f58e-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Lock "cinder-16840d38-152b-439f-8517-dc04f9f1f58e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-16840d38-152b-439f-8517-dc04f9f1f58e" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-16840d38-152b-439f-8517-dc04f9f1f58e" acquired by "delete_volume" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8620ab4f-1fed-4b9d-a0c8-3824a798f433]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:12 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e Sep 04 19:23:12 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:12 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e" returned: 0 in 0.346s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:12 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e Sep 04 19:23:12 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-870fcd56-4e1c-4639-8b8b-0fd0338a6157-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Lock "cinder-870fcd56-4e1c-4639-8b8b-0fd0338a6157-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-quobyte-57daa840-af64-423e-ad5d-f3bd154cf596" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-57daa840-af64-423e-ad5d-f3bd154cf596" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-quobyte-870fcd56-4e1c-4639-8b8b-0fd0338a6157" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-870fcd56-4e1c-4639-8b8b-0fd0338a6157" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Deleting offline snapshot 870fcd56-4e1c-4639-8b8b-0fd0338a6157 of volume 57daa840-af64-423e-ad5d-f3bd154cf596 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] snapshot_file for this snap is: volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b990a5-26ab-42bc-aad8-25e94492738a]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:12 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-16840d38-152b-439f-8517-dc04f9f1f58e" returned: 0 in 0.285s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:12 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-16840d38-152b-439f-8517-dc04f9f1f58e" released by "delete_volume" :: held 0.695s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:13 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Created reservations ['f60ac3b6-e4e1-44f0-b85d-7e83eea495c8', '072e83a8-080d-4b42-95a4-e6d79de48397', '3ce9bf66-765e-4b66-ad3f-49c52699456b', '40c853f5-bcd3-42b7-b925-7f880ac024bb'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:13 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157 Sep 04 19:23:13 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:13 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:23:13 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:13 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157" returned: 0 in 0.456s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:13 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57daa840-af64-423e-ad5d-f3bd154cf596(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:23:13 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.265s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:13 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:23:13 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Deleted volume successfully. Sep 04 19:23:13 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50f3021-b7c8-44d1-b4dd-f75170395981]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:13 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-332af865-f6bb-4918-81de-7c1f639ccce1 tempest-ProjectMemberTests-663374494 None] Lock "cinder-16840d38-152b-439f-8517-dc04f9f1f58e-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:13 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596 Sep 04 19:23:13 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:13 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596" returned: 0 in 0.426s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:13 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:13 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157 Sep 04 19:23:13 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (bc77b471-21bc-474c-8e22-9a51bf50459b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6d7483-79a4-4ce1-bb2a-5b8fbe61421b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e6d7483-79a4-4ce1-bb2a-5b8fbe61421b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-394878385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86666e2c-b23c-4003-be3e-0d1c20d2f93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:14Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b58eb0-1dbe-4a8e-9f2e-50e91715ce19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b58eb0-1dbe-4a8e-9f2e-50e91715ce19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:14 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d142cde-cda2-49fd-b7f4-4f8c63d17778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d142cde-cda2-49fd-b7f4-4f8c63d17778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86666e2c-b23c-4003-be3e-0d1c20d2f93b', 'volume_name': 'volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b81fce-9b2a-4faf-ba71-627c98baf66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b81fce-9b2a-4faf-ba71-627c98baf66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe39767-2fe5-4b25-bc59-e1b14c677d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:14 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Volume 86666e2c-b23c-4003-be3e-0d1c20d2f93b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b', 'volume_size': 1} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-394878385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86666e2c-b23c-4003-be3e-0d1c20d2f93b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:14Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Creating volume 86666e2c-b23c-4003-be3e-0d1c20d2f93b {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:23:14 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157" returned: 0 in 0.400s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:14 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b 1073741824 Sep 04 19:23:14 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:14 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157 Sep 04 19:23:14 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:14 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596.870fcd56-4e1c-4639-8b8b-0fd0338a6157" returned: 0 in 0.262s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-870fcd56-4e1c-4639-8b8b-0fd0338a6157" released by "_delete_snapshot" :: held 1.661s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-57daa840-af64-423e-ad5d-f3bd154cf596" released by "delete_snapshot" :: held 1.687s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Created reservations ['b903e5f9-6fed-4171-8afa-24f0ef5066ba', 'ebc661da-7d58-4c9f-8eb9-d1633e61d03e', '9e088f92-fb13-4603-af35-ebf6828f8dd8', 'f9373066-963c-4852-a4c3-3bb292915d04'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:14 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Delete snapshot completed successfully. Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-ce09313b-ba03-4ba2-ab60-2b123d736d04 tempest-ProjectReaderTests-571161266 None] Lock "cinder-870fcd56-4e1c-4639-8b8b-0fd0338a6157-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:14 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b 1073741824" returned: 0 in 0.476s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:14 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b Sep 04 19:23:14 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-57daa840-af64-423e-ad5d-f3bd154cf596-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:14 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b" returned: 0 in 0.275s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:14 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe39767-2fe5-4b25-bc59-e1b14c677d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8d9942-7bf5-4884-8331-9bd4a77cc9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Lock "cinder-57daa840-af64-423e-ad5d-f3bd154cf596-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:15 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Volume volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b (86666e2c-b23c-4003-be3e-0d1c20d2f93b): created successfully Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e8d9942-7bf5-4884-8331-9bd4a77cc9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (bc77b471-21bc-474c-8e22-9a51bf50459b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-quobyte-57daa840-af64-423e-ad5d-f3bd154cf596" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:15 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d94e076e-035d-43e6-8d83-94a82ab4856c tempest-ProjectMemberTests-663374494 None] Created volume successfully. Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-57daa840-af64-423e-ad5d-f3bd154cf596" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0914f154-c7a9-432f-a4ac-316e013f1510]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:15 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596 Sep 04 19:23:15 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:15 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596" returned: 0 in 0.365s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:15 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596 Sep 04 19:23:15 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:15 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-57daa840-af64-423e-ad5d-f3bd154cf596" returned: 0 in 0.256s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-57daa840-af64-423e-ad5d-f3bd154cf596" released by "delete_volume" :: held 0.689s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Created reservations ['6675c46a-4aac-438b-a182-6eeaa70bed4c', '5943f129-eedd-4d4e-9f50-b06101666f47', 'ebc60c0e-d7cb-40cb-9eea-03a136f00758', '3cf902fd-cb06-429f-9e06-cd5c29c51942'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:15 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:15 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:23:15 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:16 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.331s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:16 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Deleted volume successfully. Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] Creating offline snapshot efa8bb69-7c0a-489c-8dc2-780183411af6 of volume 86666e2c-b23c-4003-be3e-0d1c20d2f93b {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-47018156-ef57-4da3-82da-ef2a4e1e8276 tempest-ProjectReaderTests-571161266 None] Lock "cinder-57daa840-af64-423e-ad5d-f3bd154cf596-delete_volume" released by "delete_volume" :: held 1.293s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b332379d-b154-4936-9671-d8c3b54b6dd3]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:16 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b Sep 04 19:23:16 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:16 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Flow 'volume_create_manager' (ef3472c8-be67-4a8d-84ff-7b36a6f9690a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61351024-cf54-437d-a254-13b7ce5aef23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b" returned: 0 in 0.485s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61351024-cf54-437d-a254-13b7ce5aef23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095204592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9143227f-4c58-4648-ba0f-29e1841c6dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8ac596ef434e45b73c95b8f1cedd5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:17Z,use_quota=True,user_id='257b87666f6f43cbb53034b9d911eee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:16 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6 1G Sep 04 19:23:16 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e9d4a8-e45a-4978-a9e2-5495f054e235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e9d4a8-e45a-4978-a9e2-5495f054e235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3035bc-89d6-4885-bced-1ff2020bb368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc3035bc-89d6-4885-bced-1ff2020bb368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9143227f-4c58-4648-ba0f-29e1841c6dab', 'volume_name': 'volume-9143227f-4c58-4648-ba0f-29e1841c6dab', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af786e9-73fe-44e5-b892-e3f8779b9f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af786e9-73fe-44e5-b892-e3f8779b9f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5176573f-a4c4-4ff0-a5f8-869ea6034bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:16 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Volume 9143227f-4c58-4648-ba0f-29e1841c6dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9143227f-4c58-4648-ba0f-29e1841c6dab', 'volume_size': 1} Sep 04 19:23:16 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:17 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6 1G" returned: 0 in 0.463s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:17 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6 Sep 04 19:23:17 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:17 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6" returned: 0 in 0.321s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:17 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6 is being set with open permissions: ugo+rw Sep 04 19:23:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:17 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6 Sep 04 19:23:17 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:17 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6" returned: 0 in 0.245s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:17 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:17 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.info Sep 04 19:23:17 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:18 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.info" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:18 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.info is being set with open permissions: ugo+rw Sep 04 19:23:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:18 devstack sudo[105702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.info Sep 04 19:23:18 devstack sudo[105702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:18 devstack sudo[105702]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.info" returned: 0 in 0.248s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.514s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2095204592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9143227f-4c58-4648-ba0f-29e1841c6dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8ac596ef434e45b73c95b8f1cedd5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:17Z,use_quota=True,user_id='257b87666f6f43cbb53034b9d911eee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:23:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Creating volume 9143227f-4c58-4648-ba0f-29e1841c6dab {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:23:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:18 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:23:18 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:23:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:18 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab 1073741824 Sep 04 19:23:18 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:18 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fbafcf38-2796-4af8-9565-83ae5d7298da tempest-ProjectMemberTests-663374494 None] Create snapshot completed successfully Sep 04 19:23:18 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab 1073741824" returned: 0 in 0.472s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:18 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:18 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab Sep 04 19:23:18 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:19 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab" returned: 0 in 0.234s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5176573f-a4c4-4ff0-a5f8-869ea6034bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9143227f-4c58-4648-ba0f-29e1841c6dab', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b827ed63-7462-4023-ad32-e61515fdf71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:19 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Volume volume-9143227f-4c58-4648-ba0f-29e1841c6dab (9143227f-4c58-4648-ba0f-29e1841c6dab): created successfully Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b827ed63-7462-4023-ad32-e61515fdf71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Flow 'volume_create_manager' (ef3472c8-be67-4a8d-84ff-7b36a6f9690a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:19 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-948ff121-d02c-4b0e-a460-bd6845698454 tempest-ProjectReaderTests-571161266 None] Created volume successfully. Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-efa8bb69-7c0a-489c-8dc2-780183411af6-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Lock "cinder-efa8bb69-7c0a-489c-8dc2-780183411af6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-86666e2c-b23c-4003-be3e-0d1c20d2f93b" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-86666e2c-b23c-4003-be3e-0d1c20d2f93b" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-efa8bb69-7c0a-489c-8dc2-780183411af6" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-efa8bb69-7c0a-489c-8dc2-780183411af6" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Deleting offline snapshot efa8bb69-7c0a-489c-8dc2-780183411af6 of volume 86666e2c-b23c-4003-be3e-0d1c20d2f93b {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] snapshot_file for this snap is: volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c8603a-f4f6-4a3e-bc14-e6b11ba1922e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:19 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6 Sep 04 19:23:19 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:19 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6" returned: 0 in 0.352s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed7ab41-42eb-4d0a-b647-41bcf3b6505e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:19 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:20 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b Sep 04 19:23:20 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:20 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] Creating offline snapshot 22797ddc-8853-4d3b-8282-2b5d7a050ec0 of volume 9143227f-4c58-4648-ba0f-29e1841c6dab {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:23:20 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64c046b-e134-4aa2-8133-63f0fc38b663]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:20 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab Sep 04 19:23:20 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:20 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b" returned: 0 in 0.408s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:20 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6 Sep 04 19:23:20 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:20 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab" returned: 0 in 0.425s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:20 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0 1G Sep 04 19:23:20 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:20 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6" returned: 0 in 0.390s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:20 devstack sudo[105738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6 Sep 04 19:23:20 devstack sudo[105738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:20 devstack sudo[105738]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:20 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b.efa8bb69-7c0a-489c-8dc2-780183411af6" returned: 0 in 0.271s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:20 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0 1G" returned: 0 in 0.504s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9143227f-4c58-4648-ba0f-29e1841c6dab -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-efa8bb69-7c0a-489c-8dc2-780183411af6" released by "_delete_snapshot" :: held 1.547s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-86666e2c-b23c-4003-be3e-0d1c20d2f93b" released by "delete_snapshot" :: held 1.578s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:21 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9143227f-4c58-4648-ba0f-29e1841c6dab -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0 Sep 04 19:23:21 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Created reservations ['5632442d-df6a-4b93-b5f8-f30d5c9b56b9', 'e8f92261-281a-4939-a712-fe47a5f167a3', '45f7497c-c4f0-4dbf-a194-bd5483f2cfba', 'd504d0e8-c990-4cfc-ae8e-78dc4738bda8'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:21 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Delete snapshot completed successfully. Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c67bc928-7665-4f7e-8497-a40f65b72292 tempest-ProjectMemberTests-663374494 None] Lock "cinder-efa8bb69-7c0a-489c-8dc2-780183411af6-delete_snapshot" released by "delete_snapshot" :: held 1.737s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:21 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9143227f-4c58-4648-ba0f-29e1841c6dab -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0" returned: 0 in 0.291s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:21 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0 is being set with open permissions: ugo+rw Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:21 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0 Sep 04 19:23:21 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:21 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0" returned: 0 in 0.231s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:21 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.info Sep 04 19:23:21 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-86666e2c-b23c-4003-be3e-0d1c20d2f93b-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Lock "cinder-86666e2c-b23c-4003-be3e-0d1c20d2f93b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-86666e2c-b23c-4003-be3e-0d1c20d2f93b" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-86666e2c-b23c-4003-be3e-0d1c20d2f93b" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd90d5a6-4db0-479c-9d1a-2fae004665e3]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:21 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.info" returned: 0 in 0.267s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:21 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.info is being set with open permissions: ugo+rw Sep 04 19:23:21 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:21 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b Sep 04 19:23:21 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:21 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.info Sep 04 19:23:21 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:22 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.info" returned: 0 in 0.251s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:22 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.078s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b" returned: 0 in 0.387s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:22 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b Sep 04 19:23:22 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:22 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-affce750-130a-4844-9731-61ff6c3e832f tempest-ProjectReaderTests-571161266 None] Create snapshot completed successfully Sep 04 19:23:22 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-86666e2c-b23c-4003-be3e-0d1c20d2f93b" returned: 0 in 0.252s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-86666e2c-b23c-4003-be3e-0d1c20d2f93b" released by "delete_volume" :: held 0.697s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:22 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Created reservations ['d268222b-fcff-4a4f-83a0-7adbf1e43e06', '3db28f0e-9dad-48fd-b466-d1d72bc86d9e', 'ced35e81-1174-4933-a989-bf0142883125', 'bdc91dca-ff17-4e43-a21f-24a1f4299d03'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:22 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:22 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:23:22 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:22 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:22 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.249s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:22 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:23:22 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Deleted volume successfully. Sep 04 19:23:22 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f028f42d-4beb-4682-9065-09c9550a98c5 tempest-ProjectMemberTests-663374494 None] Lock "cinder-86666e2c-b23c-4003-be3e-0d1c20d2f93b-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-22797ddc-8853-4d3b-8282-2b5d7a050ec0-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (2dcaa255-a912-49c5-95f1-7720928c5f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7c8a8f-f991-49cf-9078-f678fe95555b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c7c8a8f-f991-49cf-9078-f678fe95555b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-172560014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f3d8f6-9ff8-4152-9740-0479f9ae2d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:23Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde35cd1-b746-4820-bc33-3c4f44df3f7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dde35cd1-b746-4820-bc33-3c4f44df3f7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16af9d0b-a6b9-419b-9744-286c95391f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16af9d0b-a6b9-419b-9744-286c95391f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48f3d8f6-9ff8-4152-9740-0479f9ae2d0d', 'volume_name': 'volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066f899c-8471-4a62-80b7-3f82e36a087d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (066f899c-8471-4a62-80b7-3f82e36a087d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895662ed-08c0-4309-b2ca-08db94a16474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:23 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Volume 48f3d8f6-9ff8-4152-9740-0479f9ae2d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d', 'volume_size': 1} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-172560014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48f3d8f6-9ff8-4152-9740-0479f9ae2d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:23Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Creating volume 48f3d8f6-9ff8-4152-9740-0479f9ae2d0d {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:23:23 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Lock "cinder-22797ddc-8853-4d3b-8282-2b5d7a050ec0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.114s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-quobyte-9143227f-4c58-4648-ba0f-29e1841c6dab" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:23 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d 1073741824 Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-9143227f-4c58-4648-ba0f-29e1841c6dab" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-quobyte-22797ddc-8853-4d3b-8282-2b5d7a050ec0" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:23 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-22797ddc-8853-4d3b-8282-2b5d7a050ec0" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Deleting offline snapshot 22797ddc-8853-4d3b-8282-2b5d7a050ec0 of volume 9143227f-4c58-4648-ba0f-29e1841c6dab {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] snapshot_file for this snap is: volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b996200-161a-4fd2-9214-0dfb9882cbe3]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:23 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0 Sep 04 19:23:23 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:23 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d 1073741824" returned: 0 in 0.410s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:23 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0" returned: 0 in 0.371s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9143227f-4c58-4648-ba0f-29e1841c6dab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:23:23 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d Sep 04 19:23:23 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e245f5df-b1bb-4a01-86cb-de03cc480dde]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:23 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:23 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab Sep 04 19:23:23 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:24 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d" returned: 0 in 0.246s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895662ed-08c0-4309-b2ca-08db94a16474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1bcb80-a175-42b5-8ab2-3caca86e43c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:24 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Volume volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d (48f3d8f6-9ff8-4152-9740-0479f9ae2d0d): created successfully Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e1bcb80-a175-42b5-8ab2-3caca86e43c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (2dcaa255-a912-49c5-95f1-7720928c5f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:24 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e8bb70c2-0399-4fa8-9296-b16181f8c9b3 tempest-ProjectMemberTests-663374494 None] Created volume successfully. Sep 04 19:23:24 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab" returned: 0 in 0.403s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:24 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0 Sep 04 19:23:24 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] Creating offline snapshot be3bb526-3478-43ce-9e14-c1b2837d42eb of volume 48f3d8f6-9ff8-4152-9740-0479f9ae2d0d {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8ae3db-1851-4ef6-b52e-dc25b9d740f3]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:24 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0" returned: 0 in 0.395s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:24 devstack sudo[105796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d Sep 04 19:23:24 devstack sudo[105796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:24 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0 Sep 04 19:23:24 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:24 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab.22797ddc-8853-4d3b-8282-2b5d7a050ec0" returned: 0 in 0.246s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:24 devstack sudo[105796]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d" returned: 0 in 0.389s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-22797ddc-8853-4d3b-8282-2b5d7a050ec0" released by "_delete_snapshot" :: held 1.541s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-9143227f-4c58-4648-ba0f-29e1841c6dab" released by "delete_snapshot" :: held 1.564s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:24 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb 1G Sep 04 19:23:24 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:24 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Created reservations ['9a157dcc-8253-4c08-b3a1-540d3ae6d835', 'afc55d4b-3a16-4fa6-b669-2c4cd56917b9', 'dfb778f3-5d1e-4b0f-8db0-2837584198c9', 'c6f5c72c-2d3d-4103-8a8c-cb1b279f174b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:25 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Delete snapshot completed successfully. Sep 04 19:23:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-04c1b51b-da28-4933-9c5c-f5f939560641 tempest-ProjectReaderTests-571161266 None] Lock "cinder-22797ddc-8853-4d3b-8282-2b5d7a050ec0-delete_snapshot" released by "delete_snapshot" :: held 1.711s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:25 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb 1G" returned: 0 in 0.454s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:25 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb Sep 04 19:23:25 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-9143227f-4c58-4648-ba0f-29e1841c6dab-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Lock "cinder-9143227f-4c58-4648-ba0f-29e1841c6dab-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-quobyte-9143227f-4c58-4648-ba0f-29e1841c6dab" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:25 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-9143227f-4c58-4648-ba0f-29e1841c6dab" acquired by "delete_volume" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:25 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3de254-a251-4429-af0f-6a19c9ae5666]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:25 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb" returned: 0 in 0.398s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:25 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb is being set with open permissions: ugo+rw Sep 04 19:23:25 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:25 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab Sep 04 19:23:25 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:25 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb Sep 04 19:23:25 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:26 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb" returned: 0 in 0.262s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:26 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab" returned: 0 in 0.420s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:26 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.info Sep 04 19:23:26 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:26 devstack sudo[105825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab Sep 04 19:23:26 devstack sudo[105825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:26 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.info" returned: 0 in 0.269s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:26 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.info is being set with open permissions: ugo+rw Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:26 devstack sudo[105825]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-9143227f-4c58-4648-ba0f-29e1841c6dab" returned: 0 in 0.264s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:26 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.info Sep 04 19:23:26 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-9143227f-4c58-4648-ba0f-29e1841c6dab" released by "delete_volume" :: held 0.769s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Created reservations ['47e990bc-cd52-459e-b58b-b26cce549a9a', 'bb66d8c1-2ddd-4ac0-b021-9eef3a544ac3', '49c8be51-6e94-4e5e-ae78-012b0d24700e', '387eda32-2e16-48f5-8f8d-f7d1a255d95f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:26 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:23:26 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:26 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.info" returned: 0 in 0.288s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.155s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-fc756c29-739a-4309-a456-338652472624 tempest-ProjectMemberTests-663374494 None] Create snapshot completed successfully Sep 04 19:23:26 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.272s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:23:26 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Deleted volume successfully. Sep 04 19:23:26 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-71a800f2-394a-43bf-9ca3-ac4339482bd0 tempest-ProjectReaderTests-571161266 None] Lock "cinder-9143227f-4c58-4648-ba0f-29e1841c6dab-delete_volume" released by "delete_volume" :: held 1.298s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Flow 'volume_create_manager' (3a0afbb5-f530-4f33-ac9a-8e632a1412d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f514981c-f721-4c5b-a696-b026b1ea3e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f514981c-f721-4c5b-a696-b026b1ea3e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-256636497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2663099-b088-48f7-908e-1ac9c6767364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8ac596ef434e45b73c95b8f1cedd5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:27Z,use_quota=True,user_id='257b87666f6f43cbb53034b9d911eee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4599f7ad-876d-4092-a9a0-56b721239817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4599f7ad-876d-4092-a9a0-56b721239817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ced04b-b132-44c8-8449-552c1b9f53b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ced04b-b132-44c8-8449-552c1b9f53b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2663099-b088-48f7-908e-1ac9c6767364', 'volume_name': 'volume-f2663099-b088-48f7-908e-1ac9c6767364', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2702e99-6ffe-4379-8d13-953819074ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2702e99-6ffe-4379-8d13-953819074ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c4a9b4-6602-4c4a-921f-d4fe26ecee2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:27 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Volume f2663099-b088-48f7-908e-1ac9c6767364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2663099-b088-48f7-908e-1ac9c6767364', 'volume_size': 1} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-256636497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2663099-b088-48f7-908e-1ac9c6767364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8ac596ef434e45b73c95b8f1cedd5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:27Z,use_quota=True,user_id='257b87666f6f43cbb53034b9d911eee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Creating volume f2663099-b088-48f7-908e-1ac9c6767364 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:23:27 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:27 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364 1073741824 Sep 04 19:23:27 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:27 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-be3bb526-3478-43ce-9e14-c1b2837d42eb-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364 1073741824" returned: 0 in 0.472s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Lock "cinder-be3bb526-3478-43ce-9e14-c1b2837d42eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-be3bb526-3478-43ce-9e14-c1b2837d42eb" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-be3bb526-3478-43ce-9e14-c1b2837d42eb" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Deleting offline snapshot be3bb526-3478-43ce-9e14-c1b2837d42eb of volume 48f3d8f6-9ff8-4152-9740-0479f9ae2d0d {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:23:27 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364 Sep 04 19:23:27 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] snapshot_file for this snap is: volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c74ce91-2fe1-42ab-93c9-62645408610e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:27 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:27 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb Sep 04 19:23:27 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:28 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364" returned: 0 in 0.274s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:23:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c4a9b4-6602-4c4a-921f-d4fe26ecee2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2663099-b088-48f7-908e-1ac9c6767364', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431593cd-f32b-4eed-90b8-59555de894de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:28 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Volume volume-f2663099-b088-48f7-908e-1ac9c6767364 (f2663099-b088-48f7-908e-1ac9c6767364): created successfully Sep 04 19:23:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (431593cd-f32b-4eed-90b8-59555de894de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:28 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Flow 'volume_create_manager' (3a0afbb5-f530-4f33-ac9a-8e632a1412d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:28 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a29a0b39-6952-4b08-8b76-aa1299f889f7 tempest-ProjectReaderTests-571161266 None] Created volume successfully. Sep 04 19:23:28 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb" returned: 0 in 0.383s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:28 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:23:28 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a59b2d-0761-4e39-9845-c662ab239ff4]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:28 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d Sep 04 19:23:28 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:28 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d" returned: 0 in 0.364s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:28 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb Sep 04 19:23:28 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:28 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb" returned: 0 in 0.350s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:28 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:28 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb Sep 04 19:23:28 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:29 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d.be3bb526-3478-43ce-9e14-c1b2837d42eb" returned: 0 in 0.247s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-be3bb526-3478-43ce-9e14-c1b2837d42eb" released by "_delete_snapshot" :: held 1.457s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d" released by "delete_snapshot" :: held 1.498s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Created reservations ['5f4583d4-b9c1-49a8-900d-787c4bdaeb98', 'f32d7e15-ea2d-44fd-a8f7-00130bd448bc', 'f3dbe15d-a69e-47cb-b128-e5d3b6cd8bec', '28a2cd19-3dc3-472f-848c-5058e50b2b44'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] Creating offline snapshot 8fe4a357-3fc8-4fe5-9702-b51cf917298a of volume f2663099-b088-48f7-908e-1ac9c6767364 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28356cb-0d9b-4cfe-b7d4-832dca5f40b8]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:29 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Delete snapshot completed successfully. Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e29e7568-83ad-45dc-8d3f-c78039ce3b51 tempest-ProjectMemberTests-663374494 None] Lock "cinder-be3bb526-3478-43ce-9e14-c1b2837d42eb-delete_snapshot" released by "delete_snapshot" :: held 1.733s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:29 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364 Sep 04 19:23:29 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:29 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364" returned: 0 in 0.367s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:29 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a 1G Sep 04 19:23:29 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Lock "cinder-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca8752c-b021-4245-a20c-895f07b58cc4]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:29 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:30 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d Sep 04 19:23:30 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:30 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a 1G" returned: 0 in 0.457s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2663099-b088-48f7-908e-1ac9c6767364 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:30 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2663099-b088-48f7-908e-1ac9c6767364 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a Sep 04 19:23:30 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:30 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d" returned: 0 in 0.408s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:30 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d Sep 04 19:23:30 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:30 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2663099-b088-48f7-908e-1ac9c6767364 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a" returned: 0 in 0.322s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:30 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a is being set with open permissions: ugo+rw Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:30 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a Sep 04 19:23:30 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:30 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d" returned: 0 in 0.277s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d" released by "delete_volume" :: held 0.758s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Created reservations ['27dbb0e7-2887-42d7-9fee-0ca641e35a32', '02c6bb5c-e258-4d75-b97c-297df3f7a626', '8bb0fdba-1d3d-48f5-9919-db565acccbe4', 'd1973eea-599b-4c69-9d4a-41795c6e1e9c'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:30 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a" returned: 0 in 0.287s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:30 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:23:30 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:30 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:30 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.info Sep 04 19:23:30 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:31 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.277s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:23:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Deleted volume successfully. Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-025f3753-7fc5-4760-a535-350f0b75feed tempest-ProjectMemberTests-663374494 None] Lock "cinder-48f3d8f6-9ff8-4152-9740-0479f9ae2d0d-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:31 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.info" returned: 0 in 0.291s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:31 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.info is being set with open permissions: ugo+rw Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:31 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.info Sep 04 19:23:31 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:31 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.info" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.078s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:31 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c6e5e0cb-5953-49f5-bc1e-e3ee68307324 tempest-ProjectReaderTests-571161266 None] Create snapshot completed successfully Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (f37856f7-be1b-43aa-b532-d30b3f9e7e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe2575d-2216-4335-84e3-77f3fab396bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe2575d-2216-4335-84e3-77f3fab396bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1143657056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3957be-a5a0-424d-8bf0-edeab802316b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:31Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e59038-49f3-4090-a6d5-6f73ebe2111b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e59038-49f3-4090-a6d5-6f73ebe2111b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8896f5f2-a47d-4794-ae85-984ac9d88c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8896f5f2-a47d-4794-ae85-984ac9d88c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb3957be-a5a0-424d-8bf0-edeab802316b', 'volume_name': 'volume-fb3957be-a5a0-424d-8bf0-edeab802316b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28108a8-935c-4282-96ff-36818273bc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28108a8-935c-4282-96ff-36818273bc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f38007-9a28-4fce-bcc8-b73d2e1c3a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:31 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Volume fb3957be-a5a0-424d-8bf0-edeab802316b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb3957be-a5a0-424d-8bf0-edeab802316b', 'volume_size': 1} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1143657056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3957be-a5a0-424d-8bf0-edeab802316b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:31Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Creating volume fb3957be-a5a0-424d-8bf0-edeab802316b {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:23:31 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:31 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b 1073741824 Sep 04 19:23:31 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:31 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:31 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b 1073741824" returned: 0 in 0.386s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:32 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b Sep 04 19:23:32 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:32 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b" returned: 0 in 0.241s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6f38007-9a28-4fce-bcc8-b73d2e1c3a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb3957be-a5a0-424d-8bf0-edeab802316b', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e5975e-be75-4a10-9651-501b8cb31976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:32 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Volume volume-fb3957be-a5a0-424d-8bf0-edeab802316b (fb3957be-a5a0-424d-8bf0-edeab802316b): created successfully Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e5975e-be75-4a10-9651-501b8cb31976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (f37856f7-be1b-43aa-b532-d30b3f9e7e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:32 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-55c49ada-0613-4000-b882-7748a026a355 tempest-ProjectMemberTests-663374494 None] Created volume successfully. Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-8fe4a357-3fc8-4fe5-9702-b51cf917298a-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Lock "cinder-8fe4a357-3fc8-4fe5-9702-b51cf917298a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-quobyte-f2663099-b088-48f7-908e-1ac9c6767364" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-f2663099-b088-48f7-908e-1ac9c6767364" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-quobyte-8fe4a357-3fc8-4fe5-9702-b51cf917298a" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-8fe4a357-3fc8-4fe5-9702-b51cf917298a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Deleting offline snapshot 8fe4a357-3fc8-4fe5-9702-b51cf917298a of volume f2663099-b088-48f7-908e-1ac9c6767364 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] snapshot_file for this snap is: volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[326cdf93-3d48-4c1c-925b-662228ad4ae3]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] Creating offline snapshot e3290fca-02d0-446c-bbf9-9a698cb5d85e of volume fb3957be-a5a0-424d-8bf0-edeab802316b {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[c132e82d-6449-40ea-983c-412d0d292ff9]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:32 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:32 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a Sep 04 19:23:32 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:32 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b Sep 04 19:23:32 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:33 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a" returned: 0 in 0.366s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:33 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2663099-b088-48f7-908e-1ac9c6767364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:23:33 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[9495aba6-c246-4df3-b5d2-4a1949680321]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:33 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b" returned: 0 in 0.344s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:33 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e 1G Sep 04 19:23:33 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:33 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364 Sep 04 19:23:33 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:33 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364" returned: 0 in 0.367s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:33 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a Sep 04 19:23:33 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:33 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e 1G" returned: 0 in 0.388s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb3957be-a5a0-424d-8bf0-edeab802316b -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:33 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb3957be-a5a0-424d-8bf0-edeab802316b -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e Sep 04 19:23:33 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:33 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb3957be-a5a0-424d-8bf0-edeab802316b -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e" returned: 0 in 0.277s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:33 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e is being set with open permissions: ugo+rw Sep 04 19:23:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:33 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:33 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e Sep 04 19:23:33 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a" returned: 0 in 0.337s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:33 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a Sep 04 19:23:33 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:33 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:33 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e" returned: 0 in 0.257s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:34 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364.8fe4a357-3fc8-4fe5-9702-b51cf917298a" returned: 0 in 0.251s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-8fe4a357-3fc8-4fe5-9702-b51cf917298a" released by "_delete_snapshot" :: held 1.413s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-f2663099-b088-48f7-908e-1ac9c6767364" released by "delete_snapshot" :: held 1.458s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:34 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.info Sep 04 19:23:34 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Created reservations ['b553ad8e-4d44-477a-bb76-3be53c36d37c', 'f393de6d-e0a2-4022-9bd1-261f7a56a81c', 'd3c8d301-c029-48dd-8f03-e7f022d48a06', '7c89eec7-dcae-4c45-b1a9-8e04683657c9'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Delete snapshot completed successfully. Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-d705479f-c498-4a26-9b06-333dd1619654 tempest-ProjectReaderTests-571161266 None] Lock "cinder-8fe4a357-3fc8-4fe5-9702-b51cf917298a-delete_snapshot" released by "delete_snapshot" :: held 1.611s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:34 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.info" returned: 0 in 0.280s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:34 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.info is being set with open permissions: ugo+rw Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:34 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.info Sep 04 19:23:34 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:34 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.info" returned: 0 in 0.240s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.894s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:34 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-34a4ec81-1e43-43c4-85d9-b2532ff34c44 tempest-ProjectMemberTests-663374494 None] Create snapshot completed successfully Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-f2663099-b088-48f7-908e-1ac9c6767364-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Lock "cinder-f2663099-b088-48f7-908e-1ac9c6767364-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-quobyte-f2663099-b088-48f7-908e-1ac9c6767364" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-f2663099-b088-48f7-908e-1ac9c6767364" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-e3290fca-02d0-446c-bbf9-9a698cb5d85e-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3390414-b371-44f4-9373-11a90b63aff5]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Lock "cinder-e3290fca-02d0-446c-bbf9-9a698cb5d85e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-fb3957be-a5a0-424d-8bf0-edeab802316b" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-fb3957be-a5a0-424d-8bf0-edeab802316b" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-e3290fca-02d0-446c-bbf9-9a698cb5d85e" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-e3290fca-02d0-446c-bbf9-9a698cb5d85e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Deleting offline snapshot e3290fca-02d0-446c-bbf9-9a698cb5d85e of volume fb3957be-a5a0-424d-8bf0-edeab802316b {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] snapshot_file for this snap is: volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d61848-b23f-4231-9ff0-a96b0d7fba00]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:34 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:34 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364 Sep 04 19:23:34 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:35 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e Sep 04 19:23:35 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:35 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364" returned: 0 in 0.357s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:35 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364 Sep 04 19:23:35 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:35 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e" returned: 0 in 0.374s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb3957be-a5a0-424d-8bf0-edeab802316b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a22777-15df-4cfb-9304-24e77a76bb88]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:35 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b Sep 04 19:23:35 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:35 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-f2663099-b088-48f7-908e-1ac9c6767364" returned: 0 in 0.260s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-f2663099-b088-48f7-908e-1ac9c6767364" released by "delete_volume" :: held 0.678s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Created reservations ['42dd17c1-aa53-4379-9389-91d0a817586a', '5fe48f6d-3a8f-41dd-9896-5b79f23959a0', '1e5ed384-d4fd-4dc1-8e77-99bd1b3ddaa4', '25010cc8-26f9-4696-a34d-753dc7ab7fcc'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:35 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:23:35 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:35 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b" returned: 0 in 0.358s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:35 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e Sep 04 19:23:35 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:35 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.260s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:23:35 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Deleted volume successfully. Sep 04 19:23:35 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8f399c6d-4998-4399-bee7-0a78dd525791 tempest-ProjectReaderTests-571161266 None] Lock "cinder-f2663099-b088-48f7-908e-1ac9c6767364-delete_volume" released by "delete_volume" :: held 1.138s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:36 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e" returned: 0 in 0.368s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:36 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e Sep 04 19:23:36 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:36 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b.e3290fca-02d0-446c-bbf9-9a698cb5d85e" returned: 0 in 0.257s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-e3290fca-02d0-446c-bbf9-9a698cb5d85e" released by "_delete_snapshot" :: held 1.452s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-fb3957be-a5a0-424d-8bf0-edeab802316b" released by "delete_snapshot" :: held 1.475s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Flow 'volume_create_manager' (98448a7d-de5c-40b9-b228-cd635e6a88c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00231dee-207c-464d-a615-6d45252e34e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00231dee-207c-464d-a615-6d45252e34e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1398918001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e071cd13-02e5-4df2-93de-07e1849dda98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8ac596ef434e45b73c95b8f1cedd5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:36Z,use_quota=True,user_id='257b87666f6f43cbb53034b9d911eee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2701c99-622b-460d-967e-8e6b2eb8b284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2701c99-622b-460d-967e-8e6b2eb8b284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38245abb-1f9c-4ed2-b5ff-ebc7f7404b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38245abb-1f9c-4ed2-b5ff-ebc7f7404b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e071cd13-02e5-4df2-93de-07e1849dda98', 'volume_name': 'volume-e071cd13-02e5-4df2-93de-07e1849dda98', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101a3eac-81db-499c-9f02-f8072a400f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (101a3eac-81db-499c-9f02-f8072a400f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1623b3ba-225f-4504-823b-3101b5979d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:36 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Volume e071cd13-02e5-4df2-93de-07e1849dda98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e071cd13-02e5-4df2-93de-07e1849dda98', 'volume_size': 1} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1398918001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e071cd13-02e5-4df2-93de-07e1849dda98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8ac596ef434e45b73c95b8f1cedd5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:36Z,use_quota=True,user_id='257b87666f6f43cbb53034b9d911eee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Creating volume e071cd13-02e5-4df2-93de-07e1849dda98 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:23:36 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:36 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98 1073741824 Sep 04 19:23:36 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Created reservations ['ec0f75f7-7079-45d6-992e-4885c5db8c66', 'a1f5815a-e640-4e2f-a8e8-f8637dfa1552', '7adc8bd7-01d0-495d-8b2b-d292be116bcb', 'b10db636-957e-4b12-8528-fc928ebd6c7f'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Delete snapshot completed successfully. Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-1b09c8eb-4c90-4b83-a0e9-d2d3e1274798 tempest-ProjectMemberTests-663374494 None] Lock "cinder-e3290fca-02d0-446c-bbf9-9a698cb5d85e-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:36 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98 1073741824" returned: 0 in 0.385s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:36 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98 Sep 04 19:23:36 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-fb3957be-a5a0-424d-8bf0-edeab802316b-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:36 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Lock "cinder-fb3957be-a5a0-424d-8bf0-edeab802316b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-fb3957be-a5a0-424d-8bf0-edeab802316b" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-fb3957be-a5a0-424d-8bf0-edeab802316b" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:37 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98" returned: 0 in 0.266s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1623b3ba-225f-4504-823b-3101b5979d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e071cd13-02e5-4df2-93de-07e1849dda98', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ce726b-951a-432a-b787-322e341d8a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[4374f979-1e7c-4b59-bc04-27f4bb870318]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:37 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Volume volume-e071cd13-02e5-4df2-93de-07e1849dda98 (e071cd13-02e5-4df2-93de-07e1849dda98): created successfully Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ce726b-951a-432a-b787-322e341d8a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Flow 'volume_create_manager' (98448a7d-de5c-40b9-b228-cd635e6a88c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:37 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-eb983818-2352-4dbe-ada1-2c49c9748d82 tempest-ProjectReaderTests-571161266 None] Created volume successfully. Sep 04 19:23:37 devstack sudo[106027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b Sep 04 19:23:37 devstack sudo[106027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:37 devstack sudo[106027]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b" returned: 0 in 0.376s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:37 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b Sep 04 19:23:37 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] Creating offline snapshot 12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf of volume e071cd13-02e5-4df2-93de-07e1849dda98 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[374f0ca2-e41b-43ad-8967-e084d311c507]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:37 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98 Sep 04 19:23:37 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:37 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-fb3957be-a5a0-424d-8bf0-edeab802316b" returned: 0 in 0.244s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-fb3957be-a5a0-424d-8bf0-edeab802316b" released by "delete_volume" :: held 0.689s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Created reservations ['3c7e8d60-f67f-494c-84ae-39fd371c0ebc', '5e1d4e12-7d30-4ee5-9795-ee18551318ff', '7119f9c9-5fe0-4156-b85d-db8a1530e39f', '51137a74-3f1e-449a-8f44-8eb74e8c8653'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:37 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:23:37 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:37 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98" returned: 0 in 0.378s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:37 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf 1G Sep 04 19:23:37 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:38 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.251s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:23:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Deleted volume successfully. Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-e96f9d5c-2d68-43cb-b96d-645de7fd25da tempest-ProjectMemberTests-663374494 None] Lock "cinder-fb3957be-a5a0-424d-8bf0-edeab802316b-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:38 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf 1G" returned: 0 in 0.418s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e071cd13-02e5-4df2-93de-07e1849dda98 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:38 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e071cd13-02e5-4df2-93de-07e1849dda98 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf Sep 04 19:23:38 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (6c65d421-4017-4f8b-a55d-9dc2c2778d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9958012-a7fc-45b6-a064-90d6a124f4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9958012-a7fc-45b6-a064-90d6a124f4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1227812173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c18636-26f8-4688-b211-e2cfbc08d06a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:39Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:38 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c07df09-ba03-404e-8a0b-dee4034a178c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c07df09-ba03-404e-8a0b-dee4034a178c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31854536-69d5-43c5-8888-e654b8941ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31854536-69d5-43c5-8888-e654b8941ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84c18636-26f8-4688-b211-e2cfbc08d06a', 'volume_name': 'volume-84c18636-26f8-4688-b211-e2cfbc08d06a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd8ef67-d258-4e3b-823c-2ff55811241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fd8ef67-d258-4e3b-823c-2ff55811241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c794912-39e4-4a5d-92c8-b2aac84a8941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:38 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Volume 84c18636-26f8-4688-b211-e2cfbc08d06a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84c18636-26f8-4688-b211-e2cfbc08d06a', 'volume_size': 1} Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e071cd13-02e5-4df2-93de-07e1849dda98 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf" returned: 0 in 0.326s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:38 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf is being set with open permissions: ugo+rw Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:38 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf Sep 04 19:23:38 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:38 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf" returned: 0 in 0.227s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:38 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.info Sep 04 19:23:38 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:39 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.info" returned: 0 in 0.238s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:39 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.info is being set with open permissions: ugo+rw Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:39 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.info Sep 04 19:23:39 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:39 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.info" returned: 0 in 0.231s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.889s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.740s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1227812173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84c18636-26f8-4688-b211-e2cfbc08d06a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:39Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Creating volume 84c18636-26f8-4688-b211-e2cfbc08d06a {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:23:39 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:39 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a 1073741824 Sep 04 19:23:39 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:39 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-9ac454ae-35de-4bef-9522-ed89caf7cbb9 tempest-ProjectReaderTests-571161266 None] Create snapshot completed successfully Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Lock "cinder-12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-quobyte-e071cd13-02e5-4df2-93de-07e1849dda98" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-e071cd13-02e5-4df2-93de-07e1849dda98" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-quobyte-12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Deleting offline snapshot 12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf of volume e071cd13-02e5-4df2-93de-07e1849dda98 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] snapshot_file for this snap is: volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[32345dc4-3bfc-410b-8d7f-8dcf0f099f78]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:39 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf Sep 04 19:23:39 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:39 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a 1073741824" returned: 0 in 0.421s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:39 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a Sep 04 19:23:39 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:40 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf" returned: 0 in 0.348s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e071cd13-02e5-4df2-93de-07e1849dda98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7635d848-9fa1-4d26-9eaa-d46643991870]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:40 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a" returned: 0 in 0.248s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c794912-39e4-4a5d-92c8-b2aac84a8941) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84c18636-26f8-4688-b211-e2cfbc08d06a', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b73285-7c6e-40e8-88e4-107e77c2a4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:40 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Volume volume-84c18636-26f8-4688-b211-e2cfbc08d06a (84c18636-26f8-4688-b211-e2cfbc08d06a): created successfully Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4b73285-7c6e-40e8-88e4-107e77c2a4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (6c65d421-4017-4f8b-a55d-9dc2c2778d23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:40 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-1fc145d1-0606-45f3-b47b-a3423b879a87 tempest-ProjectMemberTests-663374494 None] Created volume successfully. Sep 04 19:23:40 devstack sudo[106077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98 Sep 04 19:23:40 devstack sudo[106077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:40 devstack sudo[106077]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98" returned: 0 in 0.348s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:40 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf Sep 04 19:23:40 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] Creating offline snapshot ede60ff5-7f55-4924-b97d-109784931d57 of volume 84c18636-26f8-4688-b211-e2cfbc08d06a {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f529cf-e979-4d86-a38d-c9568cb4861c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:40 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf" returned: 0 in 0.410s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:40 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf Sep 04 19:23:40 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:40 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a Sep 04 19:23:40 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:41 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98.12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf" returned: 0 in 0.239s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf" released by "_delete_snapshot" :: held 1.445s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-e071cd13-02e5-4df2-93de-07e1849dda98" released by "delete_snapshot" :: held 1.466s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Created reservations ['3d88186b-43bb-491a-84f4-cb7d19ddc339', '206749b6-7070-4d8e-a8c4-8bf246b66a33', '9fb46a1e-ef5b-49e8-b2d0-649beda5b43c', 'b5383c96-eed2-4266-aa8b-50927ad44ca3'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:41 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a" returned: 0 in 0.354s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:41 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57 1G Sep 04 19:23:41 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:41 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Delete snapshot completed successfully. Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f2d82fa7-1cae-437b-be0f-697ae9d06706 tempest-ProjectReaderTests-571161266 None] Lock "cinder-12e3dbd2-a7fc-4eb4-9cf9-4896c0f17eaf-delete_snapshot" released by "delete_snapshot" :: held 1.622s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:41 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57 1G" returned: 0 in 0.361s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84c18636-26f8-4688-b211-e2cfbc08d06a -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:41 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84c18636-26f8-4688-b211-e2cfbc08d06a -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57 Sep 04 19:23:41 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-e071cd13-02e5-4df2-93de-07e1849dda98-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:41 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Lock "cinder-e071cd13-02e5-4df2-93de-07e1849dda98-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84c18636-26f8-4688-b211-e2cfbc08d06a -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57" returned: 0 in 0.286s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:41 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57 is being set with open permissions: ugo+rw Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:41 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57 Sep 04 19:23:41 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-quobyte-e071cd13-02e5-4df2-93de-07e1849dda98" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-e071cd13-02e5-4df2-93de-07e1849dda98" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bcb422-632a-4bf0-bb67-e7c2444e181c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:41 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:42 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98 Sep 04 19:23:42 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:42 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57" returned: 0 in 0.248s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:42 devstack sudo[106112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.info Sep 04 19:23:42 devstack sudo[106112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:42 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98" returned: 0 in 0.358s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:42 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98 Sep 04 19:23:42 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:42 devstack sudo[106112]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.info" returned: 0 in 0.253s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:42 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.info is being set with open permissions: ugo+rw Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:42 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.info Sep 04 19:23:42 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:42 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e071cd13-02e5-4df2-93de-07e1849dda98" returned: 0 in 0.235s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-e071cd13-02e5-4df2-93de-07e1849dda98" released by "delete_volume" :: held 0.647s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Created reservations ['95d645f3-bb12-49d3-b331-844cf601e2a6', 'd3ab8280-8ff7-4969-af43-cb5f3b774524', 'a1c3fa2e-6df0-4280-bf59-90669a5de11b', '509499bf-15a1-44e4-b39b-2c28ff329b6b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:42 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.info" returned: 0 in 0.245s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.822s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:42 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a4ee2e6d-a765-4c08-913e-7444566c70fb tempest-ProjectMemberTests-663374494 None] Create snapshot completed successfully Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:42 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:23:42 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:42 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-ede60ff5-7f55-4924-b97d-109784931d57-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.252s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:42 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:23:43 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Deleted volume successfully. Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Lock "cinder-ede60ff5-7f55-4924-b97d-109784931d57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-84c18636-26f8-4688-b211-e2cfbc08d06a" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-84c18636-26f8-4688-b211-e2cfbc08d06a" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-ede60ff5-7f55-4924-b97d-109784931d57" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-629a7709-d189-4df7-9724-e294679643fa tempest-ProjectReaderTests-571161266 None] Lock "cinder-e071cd13-02e5-4df2-93de-07e1849dda98-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-ede60ff5-7f55-4924-b97d-109784931d57" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Deleting offline snapshot ede60ff5-7f55-4924-b97d-109784931d57 of volume 84c18636-26f8-4688-b211-e2cfbc08d06a {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] snapshot_file for this snap is: volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3865335-ffa7-4bd1-88e2-58f505753b0a]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:43 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57 Sep 04 19:23:43 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:43 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57" returned: 0 in 0.374s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Flow 'volume_create_manager' (d22af795-9562-40d5-a7db-12a3dbe6949a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b51471e-461a-4977-a9f8-f236d5b55cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84c18636-26f8-4688-b211-e2cfbc08d06a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b51471e-461a-4977-a9f8-f236d5b55cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1683223288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92098bc5-2d86-40df-b8f6-ddbbc990a2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8ac596ef434e45b73c95b8f1cedd5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:43Z,use_quota=True,user_id='257b87666f6f43cbb53034b9d911eee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a700318-74b2-4938-a3a0-bf44b0bd8616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a700318-74b2-4938-a3a0-bf44b0bd8616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c85fe1-2424-4ac3-a8cb-8e44083044c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68c85fe1-2424-4ac3-a8cb-8e44083044c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92098bc5-2d86-40df-b8f6-ddbbc990a2d7', 'volume_name': 'volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b02745a-9ec3-4cc6-9704-795cd361d54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b02745a-9ec3-4cc6-9704-795cd361d54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56d6dc2-e3d4-46f2-ae97-cb0dad561972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:43 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Volume 92098bc5-2d86-40df-b8f6-ddbbc990a2d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7', 'volume_size': 1} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1683223288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92098bc5-2d86-40df-b8f6-ddbbc990a2d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae8ac596ef434e45b73c95b8f1cedd5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:43Z,use_quota=True,user_id='257b87666f6f43cbb53034b9d911eee1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Creating volume 92098bc5-2d86-40df-b8f6-ddbbc990a2d7 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:23:43 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4e7119-5be1-4eda-9c32-1f3344e7949e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:43 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 1073741824 Sep 04 19:23:43 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:43 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a Sep 04 19:23:43 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:43 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a" returned: 0 in 0.360s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:43 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57 Sep 04 19:23:43 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:43 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:43 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 1073741824" returned: 0 in 0.407s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:44 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 Sep 04 19:23:44 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:44 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:44 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f56d6dc2-e3d4-46f2-ae97-cb0dad561972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8679d62-414e-4ee6-9e2b-d53b9e2311b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57" returned: 0 in 0.340s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:44 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Volume volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 (92098bc5-2d86-40df-b8f6-ddbbc990a2d7): created successfully Sep 04 19:23:44 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57 Sep 04 19:23:44 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8679d62-414e-4ee6-9e2b-d53b9e2311b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Flow 'volume_create_manager' (d22af795-9562-40d5-a7db-12a3dbe6949a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f77be7e2-2fa7-4b3b-8f51-9e1d6d9e4bac tempest-ProjectReaderTests-571161266 None] Created volume successfully. Sep 04 19:23:44 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a.ede60ff5-7f55-4924-b97d-109784931d57" returned: 0 in 0.245s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-ede60ff5-7f55-4924-b97d-109784931d57" released by "_delete_snapshot" :: held 1.498s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-84c18636-26f8-4688-b211-e2cfbc08d06a" released by "delete_snapshot" :: held 1.523s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Created reservations ['9ddb34e8-a433-43dc-9322-c09d6d35201c', '337d8d79-827f-4cbd-91cd-619685c813d5', '61a9eec8-e2ca-4e34-804e-150e156d3970', '5a58b636-7199-437e-8d26-84243ddba3aa'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Delete snapshot completed successfully. Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] Creating offline snapshot d5de621f-db74-44a5-8c09-eb1a6aa20fed of volume 92098bc5-2d86-40df-b8f6-ddbbc990a2d7 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-2637ad6c-d29b-4b98-8d56-5d17db6694a8 tempest-ProjectMemberTests-663374494 None] Lock "cinder-ede60ff5-7f55-4924-b97d-109784931d57-delete_snapshot" released by "delete_snapshot" :: held 1.692s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7be0f1-4a3c-4403-b03a-e316975584b7]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:44 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 Sep 04 19:23:44 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:45 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7" returned: 0 in 0.335s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:45 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed 1G Sep 04 19:23:45 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-84c18636-26f8-4688-b211-e2cfbc08d06a-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Lock "cinder-84c18636-26f8-4688-b211-e2cfbc08d06a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:45 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:23:45 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-84c18636-26f8-4688-b211-e2cfbc08d06a" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-84c18636-26f8-4688-b211-e2cfbc08d06a" acquired by "delete_volume" :: waited 0.022s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[7274f9af-3156-40b3-96ca-0a320193e87a]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:45 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a Sep 04 19:23:45 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:45 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed 1G" returned: 0 in 0.414s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:45 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.305s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:23:45 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed Sep 04 19:23:45 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:23:45 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a" returned: 0 in 0.399s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:45 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a Sep 04 19:23:45 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:45 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed" returned: 0 in 0.317s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:45 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed is being set with open permissions: ugo+rw Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:45 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed Sep 04 19:23:45 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:45 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-84c18636-26f8-4688-b211-e2cfbc08d06a" returned: 0 in 0.250s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-84c18636-26f8-4688-b211-e2cfbc08d06a" released by "delete_volume" :: held 0.712s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Created reservations ['7ad191a1-4cef-467e-a947-e3e617884263', '268d07f0-285c-457b-a28e-6a42a5f58bc3', 'ff06ffed-21c1-4ba1-8b5e-91798b95091c', 'c1f8a205-017b-4975-b916-2fea818fbfea'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:46 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed" returned: 0 in 0.243s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:46 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.info Sep 04 19:23:46 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:46 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:23:46 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:46 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.info" returned: 0 in 0.245s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:46 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.info is being set with open permissions: ugo+rw Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:46 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.info Sep 04 19:23:46 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:46 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.260s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:23:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Deleted volume successfully. Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0dbe3978-c00e-4839-82b4-7d27d932d91c tempest-ProjectMemberTests-663374494 None] Lock "cinder-84c18636-26f8-4688-b211-e2cfbc08d06a-delete_volume" released by "delete_volume" :: held 1.248s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:46 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.info" returned: 0 in 0.264s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.897s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:46 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8c34afd6-4799-4b43-9911-aa18b338079d tempest-ProjectReaderTests-571161266 None] Create snapshot completed successfully Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (8932d710-a6b8-4032-ad0d-cf2c4bb3286b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ba2964-ad4e-48fb-975e-4f294a039284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-d5de621f-db74-44a5-8c09-eb1a6aa20fed-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4ba2964-ad4e-48fb-975e-4f294a039284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-33626454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da447703-c9cf-43cc-91c7-364228dbaf4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:47Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8e97ed-d146-43e3-a048-25a06a160d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad8e97ed-d146-43e3-a048-25a06a160d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9904cecb-c72b-4068-81af-58664a4a4419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9904cecb-c72b-4068-81af-58664a4a4419) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da447703-c9cf-43cc-91c7-364228dbaf4c', 'volume_name': 'volume-da447703-c9cf-43cc-91c7-364228dbaf4c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f661a11-07da-499a-9502-d8c0b8888366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f661a11-07da-499a-9502-d8c0b8888366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5eb5fe9-cb3a-4e7d-bacf-7d3206528fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:46 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Volume da447703-c9cf-43cc-91c7-364228dbaf4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da447703-c9cf-43cc-91c7-364228dbaf4c', 'volume_size': 1} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-33626454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da447703-c9cf-43cc-91c7-364228dbaf4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:47Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Creating volume da447703-c9cf-43cc-91c7-364228dbaf4c {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:23:46 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Lock "cinder-d5de621f-db74-44a5-8c09-eb1a6aa20fed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-quobyte-92098bc5-2d86-40df-b8f6-ddbbc990a2d7" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:46 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c 1073741824 Sep 04 19:23:46 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-92098bc5-2d86-40df-b8f6-ddbbc990a2d7" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-quobyte-d5de621f-db74-44a5-8c09-eb1a6aa20fed" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-d5de621f-db74-44a5-8c09-eb1a6aa20fed" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Deleting offline snapshot d5de621f-db74-44a5-8c09-eb1a6aa20fed of volume 92098bc5-2d86-40df-b8f6-ddbbc990a2d7 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] snapshot_file for this snap is: volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f70afe1-e4a5-4031-b5dd-76599df2ed53]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:47 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed Sep 04 19:23:47 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:47 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c 1073741824" returned: 0 in 0.416s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:47 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed" returned: 0 in 0.354s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d17d8b-136a-4c48-a135-36203cb4b368]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:47 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c Sep 04 19:23:47 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:47 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 Sep 04 19:23:47 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:47 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c" returned: 0 in 0.244s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] <== create_volume: return (729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5eb5fe9-cb3a-4e7d-bacf-7d3206528fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da447703-c9cf-43cc-91c7-364228dbaf4c', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af85349-7bb8-4caa-b903-44ff2f203a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:47 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Volume volume-da447703-c9cf-43cc-91c7-364228dbaf4c (da447703-c9cf-43cc-91c7-364228dbaf4c): created successfully Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3af85349-7bb8-4caa-b903-44ff2f203a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (8932d710-a6b8-4032-ad0d-cf2c4bb3286b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8baac27e-7ffc-455c-be06-2c97302a59dd tempest-ProjectMemberTests-663374494 None] Created volume successfully. Sep 04 19:23:47 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7" returned: 0 in 0.369s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:47 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed Sep 04 19:23:47 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] Creating offline snapshot f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e of volume da447703-c9cf-43cc-91c7-364228dbaf4c {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[063af4de-46af-4eb5-a460-1c9d423ab2a9]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:48 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed" returned: 0 in 0.335s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:48 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed Sep 04 19:23:48 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:48 devstack sudo[106215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c Sep 04 19:23:48 devstack sudo[106215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:48 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7.d5de621f-db74-44a5-8c09-eb1a6aa20fed" returned: 0 in 0.246s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-d5de621f-db74-44a5-8c09-eb1a6aa20fed" released by "_delete_snapshot" :: held 1.388s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-92098bc5-2d86-40df-b8f6-ddbbc990a2d7" released by "delete_snapshot" :: held 1.410s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:48 devstack sudo[106215]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c" returned: 0 in 0.375s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:48 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e 1G Sep 04 19:23:48 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:48 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Created reservations ['09d7b2e6-a589-46f0-8256-b763d316bc5f', '46007e31-d763-4882-8ae1-6c65e19fb746', '00492fa3-a98d-4759-8015-0e40e3c5c073', 'aa607432-7d93-4ba4-8c7a-b834a9657f6e'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Delete snapshot completed successfully. Sep 04 19:23:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-0bc4b420-4b1e-4086-aeb9-c48de8ad8a92 tempest-ProjectReaderTests-571161266 None] Lock "cinder-d5de621f-db74-44a5-8c09-eb1a6aa20fed-delete_snapshot" released by "delete_snapshot" :: held 1.558s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:48 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e 1G" returned: 0 in 0.371s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da447703-c9cf-43cc-91c7-364228dbaf4c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:48 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da447703-c9cf-43cc-91c7-364228dbaf4c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e Sep 04 19:23:48 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-92098bc5-2d86-40df-b8f6-ddbbc990a2d7-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Lock "cinder-92098bc5-2d86-40df-b8f6-ddbbc990a2d7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Acquiring lock "cinder-quobyte-92098bc5-2d86-40df-b8f6-ddbbc990a2d7" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-92098bc5-2d86-40df-b8f6-ddbbc990a2d7" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:49 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da447703-c9cf-43cc-91c7-364228dbaf4c -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e" returned: 0 in 0.332s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:49 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e is being set with open permissions: ugo+rw Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcef7d0-e2cc-4333-be49-fb8be62ccae5]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:49 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e Sep 04 19:23:49 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:49 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 Sep 04 19:23:49 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:49 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e" returned: 0 in 0.243s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:49 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.info Sep 04 19:23:49 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:49 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7" returned: 0 in 0.358s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:49 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7 Sep 04 19:23:49 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:49 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.info" returned: 0 in 0.258s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:49 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.info is being set with open permissions: ugo+rw Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:49 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.info Sep 04 19:23:49 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:49 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-92098bc5-2d86-40df-b8f6-ddbbc990a2d7" returned: 0 in 0.264s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Lock "cinder-quobyte-92098bc5-2d86-40df-b8f6-ddbbc990a2d7" released by "delete_volume" :: held 0.679s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Created reservations ['67b1ebbd-826f-465e-8b92-966090ab0de2', '69ecc46d-7f7e-4914-b4af-6e506c6885cf', '705c89c4-6e72-40c1-9449-b1a74e5d7e4c', '4d021fbb-e855-48bb-85aa-6b1e22760f9c'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:49 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:23:49 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:49 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.info" returned: 0 in 0.282s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.937s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d55c90c3-52f8-465d-8833-ddd762bbca20 tempest-ProjectMemberTests-663374494 None] Create snapshot completed successfully Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:50 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Lock "cinder-f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-da447703-c9cf-43cc-91c7-364228dbaf4c" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.297s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:23:50 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Deleted volume successfully. Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-da447703-c9cf-43cc-91c7-364228dbaf4c" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-3e729e99-1a80-4ee0-8aaf-504ff2f6f903 tempest-ProjectReaderTests-571161266 None] Lock "cinder-92098bc5-2d86-40df-b8f6-ddbbc990a2d7-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Deleting offline snapshot f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e of volume da447703-c9cf-43cc-91c7-364228dbaf4c {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] snapshot_file for this snap is: volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7453e9-fe45-47a4-8052-563eea236589]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:50 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e Sep 04 19:23:50 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:50 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e" returned: 0 in 0.388s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da447703-c9cf-43cc-91c7-364228dbaf4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[49030a3f-8e53-47a1-8e62-bc574580f003]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:50 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:50 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c Sep 04 19:23:50 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:51 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c" returned: 0 in 0.372s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:51 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e Sep 04 19:23:51 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:51 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e" returned: 0 in 0.391s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:51 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e Sep 04 19:23:51 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:51 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:51 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c.f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e" returned: 0 in 0.259s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e" released by "_delete_snapshot" :: held 1.514s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-da447703-c9cf-43cc-91c7-364228dbaf4c" released by "delete_snapshot" :: held 1.549s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:51 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Created reservations ['92911f3d-a1ff-48c6-97b9-a91cd265d72b', '6a9b8015-2c52-4087-82a3-629be4503768', 'cb96c666-c694-4b08-97e6-a26d34cd06e9', '8fc6ad34-1cb4-401a-8834-f1c6ae116c3b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:51 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Delete snapshot completed successfully. Sep 04 19:23:51 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-5ed88273-2a31-4218-ac23-6780e2303ad9 tempest-ProjectMemberTests-663374494 None] Lock "cinder-f7ac384e-7ac8-4ebc-87d7-a2aab65f2b0e-delete_snapshot" released by "delete_snapshot" :: held 1.696s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-da447703-c9cf-43cc-91c7-364228dbaf4c-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Lock "cinder-da447703-c9cf-43cc-91c7-364228dbaf4c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-da447703-c9cf-43cc-91c7-364228dbaf4c" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:52 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-da447703-c9cf-43cc-91c7-364228dbaf4c" acquired by "delete_volume" :: waited 0.019s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:52 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[466a73d3-5a5a-48db-bb7a-38c7e2b8ec16]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:52 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c Sep 04 19:23:52 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:52 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c" returned: 0 in 0.361s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:52 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:52 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c Sep 04 19:23:52 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:53 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-da447703-c9cf-43cc-91c7-364228dbaf4c" returned: 0 in 0.245s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-da447703-c9cf-43cc-91c7-364228dbaf4c" released by "delete_volume" :: held 0.664s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:53 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Created reservations ['14864291-a651-4988-8516-cbaf6fe3cb6d', '4aa7007a-8af9-4fed-8d0f-b3d72564e799', 'f239fd79-f910-4204-9582-5ac223b25532', '2b284d8d-218f-44aa-a440-70a03c903bcd'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:53 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:53 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:23:53 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:53 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:53 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.272s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:53 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:23:53 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Deleted volume successfully. Sep 04 19:23:53 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-cad9c6ef-b95c-48e5-b3cf-58edf8488c55 tempest-ProjectMemberTests-663374494 None] Lock "cinder-da447703-c9cf-43cc-91c7-364228dbaf4c-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:53 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:23:53 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (7c94989b-c32e-450c-851a-64b8f4eed7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e861d389-323a-43a1-a9b6-f98c5e737aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e861d389-323a-43a1-a9b6-f98c5e737aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259253209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabe1855-d647-4b91-973e-38332347a259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:54Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40418a9-dacf-43af-bcdd-1d660ec68624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40418a9-dacf-43af-bcdd-1d660ec68624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092a7970-b4cc-4eff-b132-71cdb2da4476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (092a7970-b4cc-4eff-b132-71cdb2da4476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cabe1855-d647-4b91-973e-38332347a259', 'volume_name': 'volume-cabe1855-d647-4b91-973e-38332347a259', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3139b2-27fd-41ef-99d2-fae98566fb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3139b2-27fd-41ef-99d2-fae98566fb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a60872d-4509-43d0-81d9-0395e782d5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:54 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Volume cabe1855-d647-4b91-973e-38332347a259: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cabe1855-d647-4b91-973e-38332347a259', 'volume_size': 1} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:23:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259253209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cabe1855-d647-4b91-973e-38332347a259,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:23:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:23:54Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Creating volume cabe1855-d647-4b91-973e-38332347a259 {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:23:54 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:54 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259 1073741824 Sep 04 19:23:54 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:54 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259 1073741824" returned: 0 in 0.463s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:54 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259 Sep 04 19:23:54 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:54 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259" returned: 0 in 0.244s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a60872d-4509-43d0-81d9-0395e782d5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cabe1855-d647-4b91-973e-38332347a259', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17fe1ba6-9e84-43ea-a3bd-e87c7fe449d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:23:54 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Volume volume-cabe1855-d647-4b91-973e-38332347a259 (cabe1855-d647-4b91-973e-38332347a259): created successfully Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17fe1ba6-9e84-43ea-a3bd-e87c7fe449d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:23:54 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (7c94989b-c32e-450c-851a-64b8f4eed7c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:23:54 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-5ef27fab-bbed-4914-b864-ecd58199a995 tempest-ProjectMemberTests-663374494 None] Created volume successfully. Sep 04 19:23:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:23:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:23:55 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] Creating offline snapshot 31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 of volume cabe1855-d647-4b91-973e-38332347a259 {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:23:55 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5477fa15-19ed-4043-bf62-48685777720f]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:55 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259 Sep 04 19:23:55 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:55 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259" returned: 0 in 0.451s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:55 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:55 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 1G Sep 04 19:23:55 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:56 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 1G" returned: 0 in 0.421s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cabe1855-d647-4b91-973e-38332347a259 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:56 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cabe1855-d647-4b91-973e-38332347a259 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 Sep 04 19:23:56 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:56 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cabe1855-d647-4b91-973e-38332347a259 -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0" returned: 0 in 0.298s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:56 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 is being set with open permissions: ugo+rw Sep 04 19:23:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:56 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 Sep 04 19:23:56 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:56 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0" returned: 0 in 0.234s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:56 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.info Sep 04 19:23:56 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:56 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.info" returned: 0 in 0.229s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:56 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.info is being set with open permissions: ugo+rw Sep 04 19:23:56 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:56 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.info Sep 04 19:23:56 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:57 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.info" returned: 0 in 0.228s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.952s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:23:57 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-d4353668-29e3-4019-8219-c6b1b974a780 tempest-ProjectMemberTests-663374494 None] Create snapshot completed successfully Sep 04 19:23:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-31bcaa02-af3f-45a7-b18f-4e79c72ac4d0-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Lock "cinder-31bcaa02-af3f-45a7-b18f-4e79c72ac4d0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-cabe1855-d647-4b91-973e-38332347a259" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-cabe1855-d647-4b91-973e-38332347a259" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-31bcaa02-af3f-45a7-b18f-4e79c72ac4d0" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:57 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-31bcaa02-af3f-45a7-b18f-4e79c72ac4d0" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Deleting offline snapshot 31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 of volume cabe1855-d647-4b91-973e-38332347a259 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:23:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] snapshot_file for this snap is: volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:23:57 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2df6bde-82b4-4464-8efb-4470d934fdd8]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:57 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 Sep 04 19:23:57 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:57 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0" returned: 0 in 0.341s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:57 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cabe1855-d647-4b91-973e-38332347a259(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:23:57 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3d23dd-b34c-4ff9-bfc6-72b2d88204b4]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:57 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:57 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259 Sep 04 19:23:57 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:58 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259" returned: 0 in 0.331s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:58 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 Sep 04 19:23:58 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:58 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0" returned: 0 in 0.318s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:58 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0 Sep 04 19:23:58 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:58 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:58 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259.31bcaa02-af3f-45a7-b18f-4e79c72ac4d0" returned: 0 in 0.232s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-31bcaa02-af3f-45a7-b18f-4e79c72ac4d0" released by "_delete_snapshot" :: held 1.300s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-cabe1855-d647-4b91-973e-38332347a259" released by "delete_snapshot" :: held 1.320s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:58 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=187,cinder:UPDATE=238,cinder:INSERT=66,cinder:DELETE=17 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:23:58 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=223,cinder:DELETE=23,cinder:SELECT=183,cinder:INSERT=68 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:23:58 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Created reservations ['ab03718e-d6f8-4371-bcde-604d40238c26', '035edf39-7684-49c6-97f8-6310fe8a61a1', 'ab09e721-d30c-4914-8e24-712380b13269', '2acd549a-753d-4d44-97a6-727014e84cfc'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:23:58 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Delete snapshot completed successfully. Sep 04 19:23:58 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-829da6c5-0071-4f26-a0bf-9da57cd20c18 tempest-ProjectMemberTests-663374494 None] Lock "cinder-31bcaa02-af3f-45a7-b18f-4e79c72ac4d0-delete_snapshot" released by "delete_snapshot" :: held 1.449s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:23:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-cabe1855-d647-4b91-973e-38332347a259-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Lock "cinder-cabe1855-d647-4b91-973e-38332347a259-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-cabe1855-d647-4b91-973e-38332347a259" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:23:59 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-cabe1855-d647-4b91-973e-38332347a259" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:23:59 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[987658e6-18df-4943-b9e3-bd6f7b6385e5]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:23:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:59 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259 Sep 04 19:23:59 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:23:59 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 04 19:23:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259" returned: 0 in 0.331s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:23:59 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:23:59 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259 Sep 04 19:23:59 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:00 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cabe1855-d647-4b91-973e-38332347a259" returned: 0 in 0.226s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-cabe1855-d647-4b91-973e-38332347a259" released by "delete_volume" :: held 0.606s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:24:00 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Created reservations ['7ee0069b-56a0-4d4f-b757-7441e5a9fcae', '550cea1c-e8bb-4963-8d84-e4d054469d9d', '81c237b0-7e1c-4d45-ada5-b0b00fd73cc1', 'd2a21b3c-6878-483e-8e3f-1a84b2d3ab16'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:24:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:24:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:24:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:24:00 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:24:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:24:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:00 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:24:00 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:00 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:00 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.240s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:00 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:24:00 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Deleted volume successfully. Sep 04 19:24:00 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-4207c37a-3c3c-4386-9471-dbb4e4df0ea5 tempest-ProjectMemberTests-663374494 None] Lock "cinder-cabe1855-d647-4b91-973e-38332347a259-delete_volume" released by "delete_volume" :: held 1.021s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:24:00 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:24:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (c7c1c6fd-3baf-4fe5-a18d-1ffb950d5def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:24:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e3dbe2-3c54-4bab-8148-7a471759b6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:00 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e3dbe2-3c54-4bab-8148-7a471759b6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1204501409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5369ba1-020c-435c-843a-3c07398fcb0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:24:01Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c58f659-f2dd-4e1c-a841-1d20a061637c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c58f659-f2dd-4e1c-a841-1d20a061637c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9b6899-35ab-43a5-a018-f28589f05a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d9b6899-35ab-43a5-a018-f28589f05a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5369ba1-020c-435c-843a-3c07398fcb0f', 'volume_name': 'volume-e5369ba1-020c-435c-843a-3c07398fcb0f', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716d30a0-9a90-4882-8bd0-0e2bad918bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (716d30a0-9a90-4882-8bd0-0e2bad918bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f414f9ec-0de1-4286-886b-5d5a1c0061e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:01 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Volume e5369ba1-020c-435c-843a-3c07398fcb0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5369ba1-020c-435c-843a-3c07398fcb0f', 'volume_size': 1} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1204501409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5369ba1-020c-435c-843a-3c07398fcb0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcabf4d0f6934931b86e01ac2ca6623c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:24:01Z,use_quota=True,user_id='8f68340a7ef945a891d65c98d8e863d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Creating volume e5369ba1-020c-435c-843a-3c07398fcb0f {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:24:01 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:01 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f 1073741824 Sep 04 19:24:01 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:01 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f 1073741824" returned: 0 in 0.379s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:01 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f Sep 04 19:24:01 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:01 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f" returned: 0 in 0.233s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f414f9ec-0de1-4286-886b-5d5a1c0061e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5369ba1-020c-435c-843a-3c07398fcb0f', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2520de11-55c4-450f-a6ed-707c0637c2b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:01 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Volume volume-e5369ba1-020c-435c-843a-3c07398fcb0f (e5369ba1-020c-435c-843a-3c07398fcb0f): created successfully Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2520de11-55c4-450f-a6ed-707c0637c2b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:01 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Flow 'volume_create_manager' (c7c1c6fd-3baf-4fe5-a18d-1ffb950d5def) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:24:01 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-0bd4b7df-0c13-438a-94dd-85e911375ded tempest-ProjectMemberTests-663374494 None] Created volume successfully. Sep 04 19:24:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:24:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:24:02 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] Creating offline snapshot 4b7c6a1f-c54b-4c80-8506-da19ea3d7884 of volume e5369ba1-020c-435c-843a-3c07398fcb0f {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:24:02 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[f729a9da-21e2-4435-bd57-39f8a55ba46e]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:24:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:02 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f Sep 04 19:24:02 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:02 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f" returned: 0 in 0.365s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:02 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884 1G Sep 04 19:24:02 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:02 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884 1G" returned: 0 in 0.365s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:02 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5369ba1-020c-435c-843a-3c07398fcb0f -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:02 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5369ba1-020c-435c-843a-3c07398fcb0f -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884 Sep 04 19:24:02 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:03 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5369ba1-020c-435c-843a-3c07398fcb0f -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884" returned: 0 in 0.286s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:03 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884 is being set with open permissions: ugo+rw Sep 04 19:24:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:03 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884 Sep 04 19:24:03 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:03 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884" returned: 0 in 0.253s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:03 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.info Sep 04 19:24:03 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:03 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.info" returned: 0 in 0.236s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:03 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.info is being set with open permissions: ugo+rw Sep 04 19:24:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:03 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.info Sep 04 19:24:03 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:03 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.info" returned: 0 in 0.237s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:03 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.810s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:24:03 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-80d9ef60-91ab-4ac1-9726-8bc2c46d7fce tempest-ProjectMemberTests-663374494 None] Create snapshot completed successfully Sep 04 19:24:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-4b7c6a1f-c54b-4c80-8506-da19ea3d7884-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:24:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Lock "cinder-4b7c6a1f-c54b-4c80-8506-da19ea3d7884-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:24:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-e5369ba1-020c-435c-843a-3c07398fcb0f" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:24:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-e5369ba1-020c-435c-843a-3c07398fcb0f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:24:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-4b7c6a1f-c54b-4c80-8506-da19ea3d7884" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:24:04 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-4b7c6a1f-c54b-4c80-8506-da19ea3d7884" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:24:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Deleting offline snapshot 4b7c6a1f-c54b-4c80-8506-da19ea3d7884 of volume e5369ba1-020c-435c-843a-3c07398fcb0f {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:24:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] snapshot_file for this snap is: volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:24:04 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f098f2-48f3-4c21-8de9-ff2054d1c27b]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:24:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:04 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884 Sep 04 19:24:04 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:04 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884" returned: 0 in 0.331s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:04 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5369ba1-020c-435c-843a-3c07398fcb0f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:24:04 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e18086-6a5b-4478-9a00-ff986101cc42]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:24:04 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:04 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f Sep 04 19:24:04 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:05 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f" returned: 0 in 0.328s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:05 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884 Sep 04 19:24:05 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:05 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884" returned: 0 in 0.316s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:05 devstack sudo[106405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884 Sep 04 19:24:05 devstack sudo[106405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:05 devstack sudo[106405]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:05 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f.4b7c6a1f-c54b-4c80-8506-da19ea3d7884" returned: 0 in 0.225s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-4b7c6a1f-c54b-4c80-8506-da19ea3d7884" released by "_delete_snapshot" :: held 1.289s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:24:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-e5369ba1-020c-435c-843a-3c07398fcb0f" released by "delete_snapshot" :: held 1.314s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:24:05 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Created reservations ['4bed93e8-846b-4db7-9960-a41b4099d5e8', 'c47ad391-46bb-4745-8560-8ac85dba341b', '13ca53dd-fed3-4ebb-9040-6ecea5b4e5e4', 'cef1186e-cbe5-463f-b590-902fa2daab6b'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:24:05 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Delete snapshot completed successfully. Sep 04 19:24:05 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-8b0531c2-9393-45f8-b70c-aaced4335258 tempest-ProjectMemberTests-663374494 None] Lock "cinder-4b7c6a1f-c54b-4c80-8506-da19ea3d7884-delete_snapshot" released by "delete_snapshot" :: held 1.462s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:24:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-e5369ba1-020c-435c-843a-3c07398fcb0f-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:24:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Lock "cinder-e5369ba1-020c-435c-843a-3c07398fcb0f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:24:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Acquiring lock "cinder-quobyte-e5369ba1-020c-435c-843a-3c07398fcb0f" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:24:06 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-e5369ba1-020c-435c-843a-3c07398fcb0f" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:24:06 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfaee106-8d88-4cba-bebd-b53d8248d722]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:24:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:06 devstack sudo[106408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f Sep 04 19:24:06 devstack sudo[106408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:06 devstack sudo[106408]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f" returned: 0 in 0.338s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:06 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:06 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f Sep 04 19:24:06 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:07 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-e5369ba1-020c-435c-843a-3c07398fcb0f" returned: 0 in 0.231s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Lock "cinder-quobyte-e5369ba1-020c-435c-843a-3c07398fcb0f" released by "delete_volume" :: held 0.617s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:24:07 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Created reservations ['73ba849d-77a1-40f6-b1c7-3ce5e4dc8aa6', 'b4b74004-48b6-478f-b83c-9bc62378a885', '2e6de145-43f9-4c42-8ed3-0938adac117c', 'e44bdc1f-dc38-4f9f-aeb3-edd0e578d8d6'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:24:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:24:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:24:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:24:07 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:24:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:24:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:07 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:24:07 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:07 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:07 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.231s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:07 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:24:07 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Deleted volume successfully. Sep 04 19:24:07 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-a047ed81-45f7-45c4-8f0b-cc5bd86d28a0 tempest-ProjectMemberTests-663374494 None] Lock "cinder-e5369ba1-020c-435c-843a-3c07398fcb0f-delete_volume" released by "delete_volume" :: held 1.029s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:24:17 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=27,cinder:INSERT=10,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:24:17 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:INSERT=8,cinder:UPDATE=34,cinder:SELECT=18,cinder:DELETE=3 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Flow 'volume_create_manager' (71f68d7c-8bcc-4b08-88a3-a304d3c97df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f4ec52-1d8a-4a12-8465-243fdb321a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f4ec52-1d8a-4a12-8465-243fdb321a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1464741537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055b7f76-c41d-4078-ba2f-6f691bd9a6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f95ca122bca4420a11d865543de3895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:24:36Z,use_quota=True,user_id='e75bc0a941f14241924dbf8f2eafeef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826e5ee6-1306-46b5-8c0b-2b3ad155d6a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826e5ee6-1306-46b5-8c0b-2b3ad155d6a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333d68fc-179c-4085-862b-c536001b252a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333d68fc-179c-4085-862b-c536001b252a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '055b7f76-c41d-4078-ba2f-6f691bd9a6bd', 'volume_name': 'volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66057567-cb1b-4313-ac3d-afa9129277ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66057567-cb1b-4313-ac3d-afa9129277ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3d441d-d323-4c26-9772-d1ddd4b0df41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:35 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Volume 055b7f76-c41d-4078-ba2f-6f691bd9a6bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd', 'volume_size': 1} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1464741537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=055b7f76-c41d-4078-ba2f-6f691bd9a6bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f95ca122bca4420a11d865543de3895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:24:36Z,use_quota=True,user_id='e75bc0a941f14241924dbf8f2eafeef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)}" {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Creating volume 055b7f76-c41d-4078-ba2f-6f691bd9a6bd {{(pid=87560) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:24:35 devstack cinder-volume[87560]: INFO cinder.volume.drivers.remotefs [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] casted to osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 Sep 04 19:24:35 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd 1073741824 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:35 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd 1073741824 Sep 04 19:24:35 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:36 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd 1073741824" returned: 0 in 0.385s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:36 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd Sep 04 19:24:36 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:36 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd" returned: 0 in 0.231s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] <== create_volume: return (654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'} {{(pid=87560) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 04 19:24:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:24:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3d441d-d323-4c26-9772-d1ddd4b0df41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd', 'volume_size': 1}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cceaa0d-2116-450c-8d63-3b11a6b8e1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:36 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Volume volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd (055b7f76-c41d-4078-ba2f-6f691bd9a6bd): created successfully Sep 04 19:24:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cceaa0d-2116-450c-8d63-3b11a6b8e1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:36 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Flow 'volume_create_manager' (71f68d7c-8bcc-4b08-88a3-a304d3c97df2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:24:36 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c2e1f73f-1f64-422d-932f-dc5d71a2f37e tempest-SnapshotDependencyTests-1292294851 None] Created volume successfully. Sep 04 19:24:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:24:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:24:36 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] Creating offline snapshot 98677024-5678-4a94-823e-3b0889088db0 of volume 055b7f76-c41d-4078-ba2f-6f691bd9a6bd {{(pid=87560) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 04 19:24:36 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d938904-e464-4d70-95f5-96182c51ced9]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:24:36 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:37 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd Sep 04 19:24:37 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:37 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd" returned: 0 in 0.338s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 1G {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:37 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 1G Sep 04 19:24:37 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:37 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 1G" returned: 0 in 0.358s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:37 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 Sep 04 19:24:37 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:37 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd -F qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0" returned: 0 in 0.268s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:37 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 is being set with open permissions: ugo+rw Sep 04 19:24:37 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:37 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 Sep 04 19:24:37 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:38 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0" returned: 0 in 0.232s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:38 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.info Sep 04 19:24:38 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:38 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.info" returned: 0 in 0.238s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:38 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.info is being set with open permissions: ugo+rw Sep 04 19:24:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.info {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:38 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.info Sep 04 19:24:38 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:38 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.info" returned: 0 in 0.232s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:38 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.740s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:24:38 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-66c9445c-e921-4946-80a2-ee170d98b44b tempest-SnapshotDependencyTests-1292294851 None] Create snapshot completed successfully Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.flows.manager.create_volume [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87560) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Flow 'volume_create_manager' (1716627c-a602-4184-b2d1-eb9037d7ce49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9cf72c9-821c-44ab-bc6f-db1e21f736a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9cf72c9-821c-44ab-bc6f-db1e21f736a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-04T17:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f95ca122bca4420a11d865543de3895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-04T17:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=98677024-5678-4a94-823e-3b0889088db0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-04T17:24:40Z,use_quota=True,user_id='e75bc0a941f14241924dbf8f2eafeef6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d74f0897-5b49-4989-a273-d8c0f0e14abb),volume_type_id=d74f0897-5b49-4989-a273-d8c0f0e14abb)' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893cebe2-2247-4831-bc43-8f686c90ee67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (893cebe2-2247-4831-bc43-8f686c90ee67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959c0f7e-6744-4ec7-a98b-25445110c01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959c0f7e-6744-4ec7-a98b-25445110c01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1', 'volume_name': 'volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1', 'volume_size': 1, 'snapshot_id': '98677024-5678-4a94-823e-3b0889088db0'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd9d88b-1219-49c0-befa-37cd7838d095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cd9d88b-1219-49c0-befa-37cd7838d095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab77408a-7855-418b-8595-eb6c719208aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:39 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Volume cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1', 'volume_size': 1, 'snapshot_id': '98677024-5678-4a94-823e-3b0889088db0'} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "cinder-quobyte-98677024-5678-4a94-823e-3b0889088db0-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1" by "_create_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-quobyte-98677024-5678-4a94-823e-3b0889088db0-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Creating volume cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1 from snapshot 98677024-5678-4a94-823e-3b0889088db0 {{(pid=87560) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Selected osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860 as target Quobyte volume. {{(pid=87560) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "cinder-quobyte-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1" by "_copy_volume_from_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-quobyte-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] snapshot: 98677024-5678-4a94-823e-3b0889088db0, volume: cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1, {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b30ab5-c1cf-4482-9753-e3b1f731013c]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:24:39 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:40 devstack sudo[106494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 Sep 04 19:24:40 devstack sudo[106494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:40 devstack sudo[106494]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0" returned: 0 in 0.342s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:24:40 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[5128aa82-579a-4dab-8291-f8e15c4fee79]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:24:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:40 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd Sep 04 19:24:40 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:40 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd" returned: 0 in 0.337s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] will copy from snapshot at /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 04 19:24:40 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Creating direct copy from snapshot {{(pid=87560) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 04 19:24:40 devstack cinder-volume[87560]: DEBUG cinder.utils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Path /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1 not found in is_blk_device check {{(pid=87560) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 04 19:24:40 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:40 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1 Sep 04 19:24:40 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:44 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1" returned: 0 in 3.882s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:44 devstack cinder-volume[87560]: DEBUG cinder.image.image_utils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Image conversion details: src /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd, size 1024.00 MB, duration 3.88 sec, destination /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1 {{(pid=87560) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 04 19:24:44 devstack cinder-volume[87560]: INFO cinder.image.image_utils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Converted 1024.00 MB image at 263.67 MB/s Sep 04 19:24:44 devstack cinder-volume[87560]: WARNING cinder.volume.drivers.remotefs [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1 is being set with open permissions: ugo+rw Sep 04 19:24:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:44 devstack sudo[106518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1 Sep 04 19:24:44 devstack sudo[106518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:44 devstack sudo[106518]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1" returned: 0 in 0.236s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-quobyte-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1" released by "_copy_volume_from_snapshot" :: held 4.869s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:24:44 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-quobyte-98677024-5678-4a94-823e-3b0889088db0-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1" released by "_create_volume_from_snapshot" :: held 4.930s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:24:44 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.945s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:24:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab77408a-7855-418b-8595-eb6c719208aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1', 'volume_size': 1, 'snapshot_id': '98677024-5678-4a94-823e-3b0889088db0'}' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3d818e-b366-4ab1-a835-0d7db514fde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 04 19:24:44 devstack cinder-volume[87560]: INFO cinder.volume.flows.manager.create_volume [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Volume volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1 (cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1): created successfully Sep 04 19:24:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2f3d818e-b366-4ab1-a835-0d7db514fde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87560) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 04 19:24:44 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Flow 'volume_create_manager' (1716627c-a602-4184-b2d1-eb9037d7ce49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87560) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 04 19:24:44 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-c66cfde1-f81e-4761-af8f-69bb855cac98 tempest-SnapshotDependencyTests-1292294851 None] Created volume successfully. Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:45 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:24:45 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "cinder-98677024-5678-4a94-823e-3b0889088db0-delete_snapshot" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-98677024-5678-4a94-823e-3b0889088db0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "cinder-quobyte-055b7f76-c41d-4078-ba2f-6f691bd9a6bd" by "delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-quobyte-055b7f76-c41d-4078-ba2f-6f691bd9a6bd" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "cinder-quobyte-98677024-5678-4a94-823e-3b0889088db0" by "_delete_snapshot" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-quobyte-98677024-5678-4a94-823e-3b0889088db0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Deleting offline snapshot 98677024-5678-4a94-823e-3b0889088db0 of volume 055b7f76-c41d-4078-ba2f-6f691bd9a6bd {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] snapshot_file for this snap is: volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 {{(pid=87560) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[59fa0d26-ea2f-4ae1-8757-1c890cd524e7]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:45 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.266s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG oslo_service.periodic_task [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] Running periodic task VolumeManager._thread_info {{(pid=87560) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread count: 28 {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG cinder.volume.manager [None req-4672d802-4c33-46da-af6c-6f32443bdb5c None None] thread info: [<_MainThread(MainThread, started 136053171200128)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87560) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 04 19:24:45 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 Sep 04 19:24:45 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:45 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0" returned: 0 in 0.343s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.remotefs [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87560) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6b5c4cb-acb5-460d-bb9b-86fc0b91b5de]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:24:45 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:45 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd Sep 04 19:24:45 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:46 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd" returned: 0 in 0.507s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:46 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 Sep 04 19:24:46 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:46 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0" returned: 0 in 0.324s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:46 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0 Sep 04 19:24:46 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:46 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:46 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd.98677024-5678-4a94-823e-3b0889088db0" returned: 0 in 0.243s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-quobyte-98677024-5678-4a94-823e-3b0889088db0" released by "_delete_snapshot" :: held 1.509s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:24:46 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-quobyte-055b7f76-c41d-4078-ba2f-6f691bd9a6bd" released by "delete_snapshot" :: held 1.530s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:24:46 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Created reservations ['b54e3866-b50b-4e66-9534-6b1091deb2a6', '6e03c11e-3892-4cc2-9518-451e3bc980c3', 'f8b3229b-5a52-404e-99b9-7638e4b216e0', 'd365c5a0-0350-497e-9f1b-52e1b288f894'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:24:47 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Delete snapshot completed successfully. Sep 04 19:24:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-f96c30bb-aa41-4196-9add-8d62acb9866e tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-98677024-5678-4a94-823e-3b0889088db0-delete_snapshot" released by "delete_snapshot" :: held 1.654s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:24:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "cinder-055b7f76-c41d-4078-ba2f-6f691bd9a6bd-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:24:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-055b7f76-c41d-4078-ba2f-6f691bd9a6bd-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:24:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "cinder-quobyte-055b7f76-c41d-4078-ba2f-6f691bd9a6bd" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:24:47 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-quobyte-055b7f76-c41d-4078-ba2f-6f691bd9a6bd" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:24:47 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[99152c2a-596d-42a6-87c3-e12abaf933a2]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:24:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:47 devstack sudo[106542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd Sep 04 19:24:47 devstack sudo[106542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:47 devstack sudo[106542]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd" returned: 0 in 0.362s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:47 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:47 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd Sep 04 19:24:47 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:48 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-055b7f76-c41d-4078-ba2f-6f691bd9a6bd" returned: 0 in 0.260s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-quobyte-055b7f76-c41d-4078-ba2f-6f691bd9a6bd" released by "delete_volume" :: held 0.682s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Created reservations ['61a95eb4-6b37-49da-b7f2-1d3b69212b75', '1186f9b8-0a82-4c1b-83c2-e0da51e3e4d8', '7ea0928e-7b35-4d43-913d-bacd9fa4e030', 'c645a13a-7467-4c1e-839d-0b039e949e83'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:48 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:24:48 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:48 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.236s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:24:48 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Deleted volume successfully. Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-80c103b3-815c-461c-a1fd-749b12f47d7d tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-055b7f76-c41d-4078-ba2f-6f691bd9a6bd-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "cinder-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1-delete_volume" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "cinder-quobyte-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1" by "delete_volume" {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-quobyte-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1" acquired by "delete_volume" :: waited 0.016s {{(pid=87560) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c0a0a8-bfed-4e94-9459-1afb8e7f1596]: (4, 'qcow2') {{(pid=88714) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 04 19:24:48 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:48 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1 Sep 04 19:24:48 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:49 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1" returned: 0 in 0.344s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1 {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:49 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1 Sep 04 19:24:49 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:49 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd/volume-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1" returned: 0 in 0.260s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-quobyte-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1" released by "delete_volume" :: held 0.642s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:24:49 devstack cinder-volume[87560]: DEBUG cinder.quota [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Created reservations ['074969d3-6a1c-4fee-b304-9dc3b46f58e2', '2e16025f-518a-43e2-80b9-8685e62a59f0', '76cd7ee2-d17c-4e1d-9a84-23a591b1c236', 'f29793ac-6ba3-479d-9c92-e5bafaeefc41'] {{(pid=87560) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 04 19:24:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 04 19:24:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 04 19:24:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860': None} {{(pid=87560) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 04 19:24:49 devstack cinder-volume[87560]: DEBUG cinder.volume.drivers.quobyte [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-5c899405-9239-4a61-b7ed-53d81e3e8860'] {{(pid=87560) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 04 19:24:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.lockutils [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87560) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 04 19:24:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 04 19:24:49 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd Sep 04 19:24:49 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 04 19:24:49 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Sep 04 19:24:49 devstack cinder-volume[87560]: DEBUG oslo_concurrency.processutils [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/f4d2064ace984ae328984a9c8aa6b7cd" returned: 0 in 0.245s {{(pid=87560) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 04 19:24:49 devstack cinder-volume[87560]: DEBUG cinder.manager [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Notifying Schedulers of capabilities ... {{(pid=87560) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 04 19:24:49 devstack cinder-volume[87560]: INFO cinder.volume.manager [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Deleted volume successfully. Sep 04 19:24:49 devstack cinder-volume[87560]: DEBUG cinder.coordination [None req-dec1bd0d-3dc0-40f9-8014-41fa61d5b55b tempest-SnapshotDependencyTests-1292294851 None] Lock "cinder-cd47ee08-aaf8-4f46-9d0d-3c6f12aa76a1-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87560) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 04 19:24:59 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:UPDATE=31,cinder:INSERT=6,cinder:DELETE=2,cinder:SELECT=24 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 04 19:24:59 devstack cinder-volume[87560]: DEBUG dbcounter [-] [87560] Writing DB stats cinder:SELECT=26,cinder:UPDATE=28,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87560) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}